-- Logs begin at Thu 2022-09-22 02:05:46 UTC, end at Thu 2022-09-22 02:47:59 UTC. -- Sep 22 02:31:00.034490 dv-cinder-857075-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 22 02:31:00.043139 dv-cinder-857075-7-smb devstack@keystone.service[88065]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 22 02:31:00.045796 dv-cinder-857075-7-smb devstack@keystone.service[88065]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 02:31:00 2022] *** Sep 22 02:31:00.045926 dv-cinder-857075-7-smb devstack@keystone.service[88065]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 02:31:00.046049 dv-cinder-857075-7-smb devstack@keystone.service[88065]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 02:31:00.046156 dv-cinder-857075-7-smb devstack@keystone.service[88065]: nodename: dv-cinder-857075-7-smb Sep 22 02:31:00.046251 dv-cinder-857075-7-smb devstack@keystone.service[88065]: machine: x86_64 Sep 22 02:31:00.046353 dv-cinder-857075-7-smb devstack@keystone.service[88065]: clock source: unix Sep 22 02:31:00.046451 dv-cinder-857075-7-smb devstack@keystone.service[88065]: pcre jit disabled Sep 22 02:31:00.046551 dv-cinder-857075-7-smb devstack@keystone.service[88065]: detected number of CPU cores: 4 Sep 22 02:31:00.046659 dv-cinder-857075-7-smb devstack@keystone.service[88065]: current working directory: / Sep 22 02:31:00.046759 dv-cinder-857075-7-smb devstack@keystone.service[88065]: detected binary path: /usr/bin/uwsgi-core Sep 22 02:31:00.046865 dv-cinder-857075-7-smb devstack@keystone.service[88065]: your processes number limit is 47680 Sep 22 02:31:00.046983 dv-cinder-857075-7-smb devstack@keystone.service[88065]: your memory page size is 4096 bytes Sep 22 02:31:00.046983 dv-cinder-857075-7-smb devstack@keystone.service[88065]: detected max file descriptor number: 2048 Sep 22 02:31:00.046983 dv-cinder-857075-7-smb devstack@keystone.service[88065]: lock engine: pthread robust mutexes Sep 22 02:31:00.047237 dv-cinder-857075-7-smb devstack@keystone.service[88065]: thunder lock: enabled Sep 22 02:31:00.047327 dv-cinder-857075-7-smb devstack@keystone.service[88065]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 22 02:31:00.047402 dv-cinder-857075-7-smb devstack@keystone.service[88065]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 02:31:00.086653 dv-cinder-857075-7-smb devstack@keystone.service[88065]: Python main interpreter initialized at 0x560cb1d689c0 Sep 22 02:31:00.086653 dv-cinder-857075-7-smb devstack@keystone.service[88065]: python threads support enabled Sep 22 02:31:00.086653 dv-cinder-857075-7-smb devstack@keystone.service[88065]: your server socket listen backlog is limited to 100 connections Sep 22 02:31:00.086653 dv-cinder-857075-7-smb devstack@keystone.service[88065]: your mercy for graceful operations on workers is 90 seconds Sep 22 02:31:00.087035 dv-cinder-857075-7-smb devstack@keystone.service[88065]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 02:31:00.087112 dv-cinder-857075-7-smb devstack@keystone.service[88065]: *** Operational MODE: preforking *** Sep 22 02:31:00.087352 dv-cinder-857075-7-smb devstack@keystone.service[88065]: *** uWSGI is running in multiple interpreter mode *** Sep 22 02:31:00.087352 dv-cinder-857075-7-smb devstack@keystone.service[88065]: spawned uWSGI master process (pid: 88065) Sep 22 02:31:00.087559 dv-cinder-857075-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 22 02:31:00.089405 dv-cinder-857075-7-smb devstack@keystone.service[88065]: spawned uWSGI worker 1 (pid: 88076, cores: 1) Sep 22 02:31:00.089405 dv-cinder-857075-7-smb devstack@keystone.service[88065]: spawned uWSGI worker 2 (pid: 88077, cores: 1) Sep 22 02:31:00.089569 dv-cinder-857075-7-smb devstack@keystone.service[88065]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 02:31:04.429027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 02:31:04.429027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: from cryptography.utils import int_from_bytes Sep 22 02:31:04.429882 dv-cinder-857075-7-smb devstack@keystone.service[88077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 02:31:04.429882 dv-cinder-857075-7-smb devstack@keystone.service[88077]: from cryptography.utils import int_from_bytes Sep 22 02:31:04.433373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 02:31:04.433373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: from cryptography.utils import int_from_bytes Sep 22 02:31:04.434543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 02:31:04.434543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: from cryptography.utils import int_from_bytes Sep 22 02:31:04.480130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 02:31:04.480336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 02:31:04.480491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] command line args: [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 02:31:04.482892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 02:31:04.482892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ================================================================================ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 02:31:04.482892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] admin_token = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.482892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_dir = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.482892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.482892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_source = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.482892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] debug = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.483303 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.483303 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.483303 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.483689 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 02:31:04.483756 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.483818 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 02:31:04.483881 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.483947 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] command line args: [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 02:31:04.484009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.484170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 02:31:04.484243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_config_append = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.484340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.484409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ================================================================================ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 02:31:04.484516 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_dir = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.484587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] admin_token = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.484677 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.484842 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config_dir = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.484935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485056 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485223 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config_source = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485399 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] debug = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485588 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.485986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486257 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486349 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486469 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486790 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_config_append = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.486974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487166 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487274 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_dir = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487359 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487426 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.487952 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488553 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] publish_errors = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.488977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489058 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489311 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489676 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.489990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] standard_threads = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490372 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490451 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490614 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.490971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_journal = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_json = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_stderr = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491383 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491507 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_syslog = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] publish_errors = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.491970 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.492071 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.492178 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.492282 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.492465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.492568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.492679 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.492767 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.492934 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] standard_threads = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.493016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.493117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.493206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.493321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.493445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.493574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.493773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.493925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_journal = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.494089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.494220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_json = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.494220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_stderr = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.494394 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.494466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_syslog = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.494544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.494616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 02:31:04.494692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.494768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.494838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.494908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.494985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495155 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495485 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495647 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495734 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495887 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.495969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496512 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496663 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496741 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496913 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.496996 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.497166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.497293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.497408 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.497521 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.497639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.497776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.497891 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498316 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498670 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.498901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.499013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.499151 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.499278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.499401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.499552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.499729 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.499913 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.500123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.500322 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.500528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.500730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.500932 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.501132 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.501320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.501513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.501841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502142 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502523 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502759 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.502994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.503886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504221 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504221 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504432 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504834 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.504952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.505202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.505305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.505400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.505511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.506383 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.506516 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.506632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.506746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.506860 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.506988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507219 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507559 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.507910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.508906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.509505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.511944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512325 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512325 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.512897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.515347 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.515496 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.515620 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.515740 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.515857 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.515980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516794 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.516920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517151 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517151 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517622 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517759 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.517875 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.523606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.523765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.523890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524842 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.524962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525194 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525479 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.525958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.526198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.526315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.526315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.526544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.526660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.526660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.526958 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.527077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.527077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.external = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.527307 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.527423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528044 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528403 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.password = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.token = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.528944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529381 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529618 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.529965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530684 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.530961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531293 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531642 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.531995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.532113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.532228 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.532343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.532510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.532647 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.532781 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.532902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533062 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533186 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533303 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533417 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533797 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.533921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.534037 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.534151 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.534296 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.534430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.534598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.534831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.534998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.external = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.535175 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.535335 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.535490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.535608 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.535724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.535838 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.535951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536074 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.password = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536190 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.token = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536420 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536783 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.536899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.537959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538073 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538316 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538658 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.538897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.539010 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.539374 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.539492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.539606 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.539728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.539859 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.539974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540088 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540201 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540201 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540764 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.540885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541428 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541541 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541677 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.541990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542224 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542338 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542455 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.542919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.543032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.543205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.543844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.543967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544319 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.544900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.545114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.545114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.545346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.545502 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.545625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.545625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.545883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546235 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546575 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.546927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547825 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.547825 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548277 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548842 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.548962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549412 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549527 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549527 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549882 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.549996 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550804 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.550917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551331 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551331 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551734 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.551846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552071 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552296 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.552973 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553722 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.553953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554620 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554741 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.554855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.555993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556677 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556677 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.556904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557828 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.557828 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558040 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558165 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558165 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.558943 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559056 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559056 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559380 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559502 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559832 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.559945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560058 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.560914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561252 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.561990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562231 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562809 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.562925 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563151 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563151 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.563945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564172 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564710 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564825 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.564939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565177 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565797 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.565915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566030 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566357 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566479 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.566968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567406 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567633 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.567973 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568613 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568710 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.568983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569185 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.569988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570096 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.570935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571136 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571428 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571522 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571824 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.571920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.572984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.573784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.573784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.574111 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.574539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.574941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.576049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.576049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.576049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.576465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.576883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.577286 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.577702 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.578046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.578292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.578556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.578823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.579084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.579328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.579574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.579866 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.580115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.580360 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.580616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.580862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.581125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.581380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.581625 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.582029 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.582413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.582806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.583175 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.583545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.583917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.584300 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.585326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.585326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.585488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.585913 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.586337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.586722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.587116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.587490 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.587869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.588265 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.588676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.589086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.589427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.589722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.589956 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.590731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.590980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.591239 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.592104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.592104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.592104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.592328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.592476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 02:31:04.592659 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 02:31:04.597174 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.597406 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.597632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.606920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.622403 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.622403 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.622403 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.630910 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.634678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.634905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.649836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.650052 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.689732 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.690896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.739285 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.739514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.740036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.740279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.897446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.897716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.897915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.898131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.898347 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.898608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.904372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.904603 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.904831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.905056 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.905279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.905504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.923808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.924022 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.924250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.924472 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.924689 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.924897 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.925305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.927113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.927513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.927920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.928291 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.928519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.928741 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.928961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.937557 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.938715 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.951060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.951233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.951412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.951629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.951846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.952061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.952274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.956346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.956690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.957021 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.957350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.957697 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.958025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.958347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 02:31:04.969610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.969846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 02:31:04.970194 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.970394 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 02:31:04.970668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.970929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.971189 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.971444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.973565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.973936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 02:31:04.974323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.974543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 02:31:04.974847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.975165 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.975563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.975954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.981065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.981346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.981616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.981923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.987238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.987524 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.987799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.988086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.988869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:04.991776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:04.992060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.992343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.992621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.992906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.993164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.993432 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.993723 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.993996 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.994267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.994531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.995123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:04.998093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:04.998390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.998679 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.998971 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.999260 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.999531 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:04.999807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.000085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.000362 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.000642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.000914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.017536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.019025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.019308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.023950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.024201 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.024314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.024501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.025797 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.026089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.031249 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.031425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.031550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.031698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.031816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.037541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.037859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.038154 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.038344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.038440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.038639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.038736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.038971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.039494 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.039758 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.042872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.043219 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.043511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.043797 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.044077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.046278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.046577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.046870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.055225 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.055506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.059417 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.062332 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.062621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.062726 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.062918 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.066452 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.067117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.069538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.069861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.070298 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.073493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.073821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.074109 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.074204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.074913 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.075195 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.075478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.077755 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.081331 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.081636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.081953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.082248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.082655 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.082955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.091812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.092108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.092376 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.092638 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.099350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.099476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.099654 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.099929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.100196 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.100969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.102517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.102790 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.105427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.105980 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.106267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.106550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.106954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.107072 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.108674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.110250 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.110532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.113178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.113485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.113956 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.114262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.114558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.118050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.118336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.118622 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.118906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.119286 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.119576 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.119855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.125914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.126200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.126482 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.126765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.127056 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.127334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.127628 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.135203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.138649 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.141509 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.143091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.143676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.144552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.144835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.145233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.146752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.149641 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.151434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.151581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.153146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.153436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.153568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.153751 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.156486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.156877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.157162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.157435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.160269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.161765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.164913 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.165205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.165490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.165576 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.165796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.165880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.166323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.172956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.173240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.173520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.173793 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.173893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.174092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.174175 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.174359 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.174443 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.174629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.174905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.175172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.175449 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.175726 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.176001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.176263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.176530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.181230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 02:31:05.181521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.181832 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.182117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.182397 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.182674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.182953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.183238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.183525 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.183838 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.184122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.184385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.184658 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.184934 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 02:31:05.211042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560cb1d689c0 pid: 88077 (default app) Sep 22 02:31:05.214468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4759bd-3345-45bf-946f-c206537b639f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:05.214750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4759bd-3345-45bf-946f-c206537b639f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:05.215597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4759bd-3345-45bf-946f-c206537b639f None None] PATH_INFO: `/v3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:05.219727 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Thu Sep 22 02:31:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:05.219975 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560cb1d689c0 pid: 88076 (default app) Sep 22 02:31:12.181641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54256c9-fd8e-4ffd-9c74-98ab5cf6c332 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:12.182180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54256c9-fd8e-4ffd-9c74-98ab5cf6c332 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:12.182284 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54256c9-fd8e-4ffd-9c74-98ab5cf6c332 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:12.183555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:12.191294 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:12.191704 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:12.191837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:12.266135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: INFO dbcounter [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] Registered counter for database keystone Sep 22 02:31:12.285499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG oslo_db.sqlalchemy.engines [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 02:31:12.292026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writer thread running {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 02:31:12.472661 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG passlib.handlers.bcrypt [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88076) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 02:31:12.472958 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG passlib.handlers.bcrypt [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88076) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 02:31:12.531006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:12.532624 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:12.661889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 22 02:31:13.129886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54256c9-fd8e-4ffd-9c74-98ab5cf6c332 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:13.199515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: INFO dbcounter [None req-f54256c9-fd8e-4ffd-9c74-98ab5cf6c332 None None] Registered counter for database keystone Sep 22 02:31:13.221042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG oslo_db.sqlalchemy.engines [None req-f54256c9-fd8e-4ffd-9c74-98ab5cf6c332 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 02:31:13.227242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writer thread running {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 02:31:13.345112 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54256c9-fd8e-4ffd-9c74-98ab5cf6c332 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:13.349622 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14141e5-4d2c-4671-91f4-98166e49d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:13.350268 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14141e5-4d2c-4671-91f4-98166e49d54b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:13.350549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14141e5-4d2c-4671-91f4-98166e49d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:13.350822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14141e5-4d2c-4671-91f4-98166e49d54b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:13.359146 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14141e5-4d2c-4671-91f4-98166e49d54b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:13.414814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d14141e5-4d2c-4671-91f4-98166e49d54b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 02:31:13.415070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14141e5-4d2c-4671-91f4-98166e49d54b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:13.425312 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Sep 22 02:31:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 02:31:13.431257 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:13.446190 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414ca6-a4ee-4bfe-abd8-ef1945d2aab2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:13.451598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d83f4-296a-4cbe-a471-6b057f483c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:13.452739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d83f4-296a-4cbe-a471-6b057f483c36 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:13.453023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d83f4-296a-4cbe-a471-6b057f483c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:13.453298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d83f4-296a-4cbe-a471-6b057f483c36 admin admin] PATH_INFO: `/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:13.454820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d83f4-296a-4cbe-a471-6b057f483c36 admin admin] RBAC: Authorizing `identity:get_project(project_id=e37cfa01ad9247dab92fb4fc2b4b39f2)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:13.507363 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a80d83f4-296a-4cbe-a471-6b057f483c36 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 02:31:13.507709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d83f4-296a-4cbe-a471-6b057f483c36 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:13.512892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Thu Sep 22 02:31:13 2022] GET /identity/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:15.654962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037904-2359-4967-80b3-bf0420ec45f7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:15.655562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037904-2359-4967-80b3-bf0420ec45f7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:15.655562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037904-2359-4967-80b3-bf0420ec45f7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:15.659772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:15.666314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34126c1a-8dcb-42ea-bebf-f916589ac0e8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:15.666874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34126c1a-8dcb-42ea-bebf-f916589ac0e8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:15.666874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34126c1a-8dcb-42ea-bebf-f916589ac0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:15.688258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-34126c1a-8dcb-42ea-bebf-f916589ac0e8 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:15.689908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-34126c1a-8dcb-42ea-bebf-f916589ac0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:15.698088 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 02:31:15.974435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e037904-2359-4967-80b3-bf0420ec45f7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:15.987772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e037904-2359-4967-80b3-bf0420ec45f7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:15.992019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cbc34-33c7-456f-be93-8fa362a5b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:15.992634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cbc34-33c7-456f-be93-8fa362a5b268 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:15.992916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cbc34-33c7-456f-be93-8fa362a5b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:15.993192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cbc34-33c7-456f-be93-8fa362a5b268 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:16.001858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cbc34-33c7-456f-be93-8fa362a5b268 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:16.003655 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cbc34-33c7-456f-be93-8fa362a5b268 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:16.013321 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Sep 22 02:31:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 02:31:16.019290 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34126c1a-8dcb-42ea-bebf-f916589ac0e8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:16.029336 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34126c1a-8dcb-42ea-bebf-f916589ac0e8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:16.033831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098864bd-c105-48e4-8c91-279a0dbcb62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:16.034486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098864bd-c105-48e4-8c91-279a0dbcb62e admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:16.034762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098864bd-c105-48e4-8c91-279a0dbcb62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:16.035036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098864bd-c105-48e4-8c91-279a0dbcb62e admin admin] PATH_INFO: `/v3/users/2693edda8d0d489e8bc6601783092eda` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:16.036427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098864bd-c105-48e4-8c91-279a0dbcb62e admin admin] RBAC: Authorizing `identity:get_user(user_id=2693edda8d0d489e8bc6601783092eda)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:16.038329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098864bd-c105-48e4-8c91-279a0dbcb62e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:16.040189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Thu Sep 22 02:31:16 2022] GET /identity/v3/users/2693edda8d0d489e8bc6601783092eda => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:18.285211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506f66-93e4-4ca6-a3c9-a30791e53593 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:18.285775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506f66-93e4-4ca6-a3c9-a30791e53593 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:18.285875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506f66-93e4-4ca6-a3c9-a30791e53593 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:18.287125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:18.292881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245012-02f6-4626-92ee-e64ec307a6b4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:18.293287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245012-02f6-4626-92ee-e64ec307a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:18.293561 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245012-02f6-4626-92ee-e64ec307a6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:18.295447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54fc2-6b30-4a7b-aa46-4df1130cd4d9 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:18.295731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54fc2-6b30-4a7b-aa46-4df1130cd4d9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:18.296003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54fc2-6b30-4a7b-aa46-4df1130cd4d9 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:18.297790 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 7/11] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:31:18.303277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:18.303562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:18.303836 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:18.312851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a3245012-02f6-4626-92ee-e64ec307a6b4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:18.314057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a3245012-02f6-4626-92ee-e64ec307a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:18.344956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG passlib.handlers.bcrypt [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88077) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 02:31:18.345341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG passlib.handlers.bcrypt [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88077) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 02:31:18.394939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:18.395125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:18.396160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:18.506644 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:18.672916 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245012-02f6-4626-92ee-e64ec307a6b4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:18.696368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:18.775650 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:18.794666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245012-02f6-4626-92ee-e64ec307a6b4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:18.829958 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:18.830591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:18.830867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:18.831140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:18.841948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:18.850647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:18.851562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:18.852375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 6/14] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:18.857549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:18.876497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5b75-d5e4-4bba-aa1b-aa1fb840b937 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:18.879222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:18.914393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:18.915260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:18.915552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:18.915830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:18.939330 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:18.958041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5e8a2-41fc-43d3-bbae-9de66fb38cc8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:18.982692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:18.984332 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:18.991079 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:18.991682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:18.991966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:18.992241 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:18.992907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:18.993214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:18.994622 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:19.006717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 7/15] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:19.013017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:19.083996 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:31:19.089706 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:19.092740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:19.120229 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a6349-0522-4bc0-91fe-1a00c1fdf3a7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:19.155485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:19.156035 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:19.156311 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:19.156582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] PATH_INFO: `/v3/users/2693edda8d0d489e8bc6601783092eda` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:19.157751 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] RBAC: Authorizing `identity:get_user(user_id=2693edda8d0d489e8bc6601783092eda)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:19.159214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:19.161008 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 8/17] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:19 2022] GET /identity/v3/users/2693edda8d0d489e8bc6601783092eda => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:19.166447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:19.181009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:19.190431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806bbe-7903-4576-923b-12bb3e61ddb6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:19.227017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:19.227875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:19.228156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:19.228488 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:19.247602 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:19.249067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:19.266907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190a04-f550-4248-a4b9-4a15ecf0ffdf None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:31:19.267290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:19.268249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:31:19.269038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:31:19.269038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:31:19.269038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:19.269038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:31:19.274565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:19.304500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:19.305178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:19.305442 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:19.305746 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:19.306887 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:19.308959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:19.310542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:19.316326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:19.333458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:19.383199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e278acd-fba8-427a-88f5-265b05d18c99 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:19.398151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:19.420793 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceae1d-1a51-405b-98fd-a818436eacdf None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:19.420992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d75e6-ac20-4f03-b79e-2299671efa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:19.421354 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d75e6-ac20-4f03-b79e-2299671efa4e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:19.421635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d75e6-ac20-4f03-b79e-2299671efa4e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:19.421939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d75e6-ac20-4f03-b79e-2299671efa4e None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:19.422600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d75e6-ac20-4f03-b79e-2299671efa4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:19.422899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d75e6-ac20-4f03-b79e-2299671efa4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:19.424333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d75e6-ac20-4f03-b79e-2299671efa4e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:19.443730 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:19.460801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ed20-a5ce-4232-b5bc-6b7341b2ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:19.461447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ed20-a5ce-4232-b5bc-6b7341b2ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:19.461774 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ed20-a5ce-4232-b5bc-6b7341b2ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:19.462244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ed20-a5ce-4232-b5bc-6b7341b2ffd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:19.463680 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80ed20-a5ce-4232-b5bc-6b7341b2ffd1 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.domain.id=default, user.id=2693edda8d0d489e8bc6601783092eda) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:19.464237 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80ed20-a5ce-4232-b5bc-6b7341b2ffd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:19.467691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80ed20-a5ce-4232-b5bc-6b7341b2ffd1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:19.478252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Sep 22 02:31:19 2022] GET /identity/v3/role_assignments?user.id=2693edda8d0d489e8bc6601783092eda&scope.domain.id=default&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:22.074245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377113d3-3d24-41a4-a807-8214c36b852b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:22.074769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377113d3-3d24-41a4-a807-8214c36b852b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:22.075186 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377113d3-3d24-41a4-a807-8214c36b852b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:22.076136 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46cf17-c2fd-4fe3-ae2f-1f5e0fff0956 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:22.076510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46cf17-c2fd-4fe3-ae2f-1f5e0fff0956 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:22.076716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46cf17-c2fd-4fe3-ae2f-1f5e0fff0956 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:22.077972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:22.078354 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 11/23] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:22.085392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db499228-9fae-4c10-972a-ef2512be8d09 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:22.085829 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db499228-9fae-4c10-972a-ef2512be8d09 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:22.086301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db499228-9fae-4c10-972a-ef2512be8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:22.086774 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0d91-6bc4-44ae-ad7b-d34601f7adae None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:22.087065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0d91-6bc4-44ae-ad7b-d34601f7adae None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:22.087343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0d91-6bc4-44ae-ad7b-d34601f7adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:22.121511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-dc7c0d91-6bc4-44ae-ad7b-d34601f7adae None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:22.122788 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-dc7c0d91-6bc4-44ae-ad7b-d34601f7adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:22.138752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-db499228-9fae-4c10-972a-ef2512be8d09 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:22.140799 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-db499228-9fae-4c10-972a-ef2512be8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:22.327441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:22.329172 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6261d-4be7-4d4c-9ff0-c15efbde110f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:22.329708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6261d-4be7-4d4c-9ff0-c15efbde110f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:22.330208 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6261d-4be7-4d4c-9ff0-c15efbde110f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:22.332029 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 13/25] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:22.338096 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b142b-3718-4c6e-8051-59342e984819 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:22.338692 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b142b-3718-4c6e-8051-59342e984819 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:22.339368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b142b-3718-4c6e-8051-59342e984819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:22.369937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:22.377954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-553b142b-3718-4c6e-8051-59342e984819 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:22.379688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-553b142b-3718-4c6e-8051-59342e984819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:22.484384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:22.758326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db499228-9fae-4c10-972a-ef2512be8d09 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:22.838873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b142b-3718-4c6e-8051-59342e984819 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:22.844551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:22.847075 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:22.940043 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db499228-9fae-4c10-972a-ef2512be8d09 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:22.979450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:22.980642 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:22.980922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:22.981192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.006279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:23.016357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:23.017230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:23.018027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 14/28] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:23.028755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:23.092818 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b142b-3718-4c6e-8051-59342e984819 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:23.155320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:23.156309 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.156787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.157254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.174070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645a6bb-d770-4c0f-b1d5-874222bc3c09 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:23.176791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:23.178519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:23.181313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:31:23.200006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:23.200871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:31:23.201673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:31:23.201673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:31:23.201673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:23.206109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 15/29] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:23.215071 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:23.227418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:23.228494 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.228984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.229557 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.230502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:23.231004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:23.232588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:23.268969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 15/30] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:23.277998 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:23.302032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:23.371580 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa6af-c274-41e8-85c3-f09bf0d56836 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:23.495054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:23.496478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.496952 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.497422 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.500573 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:23.501126 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:23.503852 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:23.558454 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 16/31] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:23.559298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:23.598582 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cbde2-bbd0-4042-894e-809df96b0003 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:23.668095 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e802f-c342-4c2b-9757-a8138be91443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:23.668764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5d06-5ef1-49ea-8357-e0c63f4ba71c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:23.669588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e802f-c342-4c2b-9757-a8138be91443 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.671157 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e802f-c342-4c2b-9757-a8138be91443 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.671893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e802f-c342-4c2b-9757-a8138be91443 None admin] PATH_INFO: `/v3/users/2693edda8d0d489e8bc6601783092eda` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.674864 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e802f-c342-4c2b-9757-a8138be91443 None admin] RBAC: Authorizing `identity:get_user(user_id=2693edda8d0d489e8bc6601783092eda)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:23.678490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e802f-c342-4c2b-9757-a8138be91443 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:23.681783 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 16/32] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:23 2022] GET /identity/v3/users/2693edda8d0d489e8bc6601783092eda => generated 247 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:23.684700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e22b0-4028-47e1-b181-cd110859ed7f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.685153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e22b0-4028-47e1-b181-cd110859ed7f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.685772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e22b0-4028-47e1-b181-cd110859ed7f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.687290 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:23.689583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 17/33] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:23.691483 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e22b0-4028-47e1-b181-cd110859ed7f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:23.706849 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e98e7-a193-41f1-ada5-7227ceb8989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:23.707540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e98e7-a193-41f1-ada5-7227ceb8989d None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.707825 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e98e7-a193-41f1-ada5-7227ceb8989d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.708106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e98e7-a193-41f1-ada5-7227ceb8989d None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.708786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e98e7-a193-41f1-ada5-7227ceb8989d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:23.710214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e98e7-a193-41f1-ada5-7227ceb8989d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:23.738468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:23.806116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e22b0-4028-47e1-b181-cd110859ed7f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:23.840161 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:23.840774 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.841050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.841317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.842001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:23.843420 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:23.880123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 17/34] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 22 02:31:23 2022] POST /identity/v3/roles => generated 219 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:31:23.881474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ae3d-e3a0-4b16-9ec9-eb6198f79e7a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.882039 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ae3d-e3a0-4b16-9ec9-eb6198f79e7a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.882539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ae3d-e3a0-4b16-9ec9-eb6198f79e7a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.885165 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 18/35] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:23.897858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac74ea3-4923-4805-961b-0a2f606a5b11 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:23.897858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac74ea3-4923-4805-961b-0a2f606a5b11 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:23.897858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac74ea3-4923-4805-961b-0a2f606a5b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:23.939527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-aac74ea3-4923-4805-961b-0a2f606a5b11 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:23.941533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-aac74ea3-4923-4805-961b-0a2f606a5b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:23.992961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 18/36] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:31:23 2022] POST /identity/v3/projects => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:31:23.994237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:24.086863 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 19/37] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:24.093947 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91c0c-fad4-4151-8ec7-0bb241cd59de None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.094548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91c0c-fad4-4151-8ec7-0bb241cd59de None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.094619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91c0c-fad4-4151-8ec7-0bb241cd59de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.120390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-39f91c0c-fad4-4151-8ec7-0bb241cd59de None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:24.121751 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-39f91c0c-fad4-4151-8ec7-0bb241cd59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:24.185310 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:24.210313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653e723-ef83-4ea1-b61a-f01219301394 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:24.254742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 20/38] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:24.256844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe45a6f-c829-4f54-915e-135e769b6e11 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.257472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe45a6f-c829-4f54-915e-135e769b6e11 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.257959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe45a6f-c829-4f54-915e-135e769b6e11 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.261839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 21/39] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:24.267894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf2025-b0c5-484c-81d0-4628e3b65153 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.268539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf2025-b0c5-484c-81d0-4628e3b65153 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.269002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf2025-b0c5-484c-81d0-4628e3b65153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.284879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:24.286005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.286469 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.286944 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.289932 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:24.291872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:24.294357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 19/40] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:24.297726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8bbf2025-b0c5-484c-81d0-4628e3b65153 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:24.297726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8bbf2025-b0c5-484c-81d0-4628e3b65153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:24.301487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:24.335420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:24.404873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 22/41] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:24.438735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621caf0-10f3-4d26-82fe-a229e6f7cc38 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:24.477112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf2025-b0c5-484c-81d0-4628e3b65153 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:24.477318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:24.478001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.478338 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.478622 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] PATH_INFO: `/v3/domains/default/users/2693edda8d0d489e8bc6601783092eda/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.480932 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2693edda8d0d489e8bc6601783092eda, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:24.482878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:24.503640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 20/42] 10.222.0.57 () {58 vars in 1361 bytes} [Thu Sep 22 02:31:24 2022] PUT /identity/v3/domains/default/users/2693edda8d0d489e8bc6601783092eda/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:31:24.579604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:24.603834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:24.723111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b013e0b-18f8-470c-919a-3babfb0cb00a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:24.736972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf2025-b0c5-484c-81d0-4628e3b65153 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:24.763854 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:24.764480 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.764765 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.765043 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.765759 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:24.767166 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:24.780350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:24.780976 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.781256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.781529 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.782262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:24.783777 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:24.784565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 21/43] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 22 02:31:24 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:31:24.785243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:24.815077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 22 02:31:24 2022] POST /identity/v3/roles => generated 223 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:31:24.899218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:24.931667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408b810-eedf-438d-9dc3-8327e5e67a77 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:24.975186 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01c35c-6c6c-4f09-b765-3b19c8c1f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:24.975754 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c35c-6c6c-4f09-b765-3b19c8c1f98e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:24.976033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c35c-6c6c-4f09-b765-3b19c8c1f98e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:24.976302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c35c-6c6c-4f09-b765-3b19c8c1f98e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:24.977638 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01c35c-6c6c-4f09-b765-3b19c8c1f98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:24.979232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01c35c-6c6c-4f09-b765-3b19c8c1f98e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:24.981199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 22/45] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:24.987199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:25.024055 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:25.114472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b65ff-c2ab-45d9-966c-a6ccbb73ecb7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:25.156211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907e03d-3e61-4861-81f3-f5f1986d7a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:25.156732 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e03d-3e61-4861-81f3-f5f1986d7a3b None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:25.157009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e03d-3e61-4861-81f3-f5f1986d7a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:25.157312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e03d-3e61-4861-81f3-f5f1986d7a3b None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:25.157991 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907e03d-3e61-4861-81f3-f5f1986d7a3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:25.159437 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907e03d-3e61-4861-81f3-f5f1986d7a3b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:25.196015 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:31:24 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:31:26.851688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bbd52-7524-4788-bf64-4e323f1afa84 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:26.852203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bbd52-7524-4788-bf64-4e323f1afa84 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:26.852683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bbd52-7524-4788-bf64-4e323f1afa84 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:26.855680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 23/47] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:26.861372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d54fb-7b15-4a66-b6ac-c029cf811871 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:26.862177 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d54fb-7b15-4a66-b6ac-c029cf811871 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:26.862337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d54fb-7b15-4a66-b6ac-c029cf811871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:26.882423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6b6d54fb-7b15-4a66-b6ac-c029cf811871 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:26.883830 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6b6d54fb-7b15-4a66-b6ac-c029cf811871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:26.958492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:27.231441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bbd52-7524-4788-bf64-4e323f1afa84 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:27.349518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bbd52-7524-4788-bf64-4e323f1afa84 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:27.388380 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8178b-b552-40a5-a575-ca672056d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:27.389171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8178b-b552-40a5-a575-ca672056d40f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:27.389543 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8178b-b552-40a5-a575-ca672056d40f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:27.389873 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8178b-b552-40a5-a575-ca672056d40f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:27.402646 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8178b-b552-40a5-a575-ca672056d40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-20b8178b-b552-40a5-a575-ca672056d40f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:27.407660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:27.409464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:27.411003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 24/49] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:31:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:31:27.418986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d54fb-7b15-4a66-b6ac-c029cf811871 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:27.429501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4803e-b9ee-4ea4-9505-df867d3025ed None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:27.429899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4803e-b9ee-4ea4-9505-df867d3025ed None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:27.430241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4803e-b9ee-4ea4-9505-df867d3025ed None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:27.431656 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 25/50] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:31:27.437322 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:27.437765 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20043998-c559-477f-9b82-050d540604b4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:27.438102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20043998-c559-477f-9b82-050d540604b4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:27.438476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20043998-c559-477f-9b82-050d540604b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:27.447225 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:27.460979 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-20043998-c559-477f-9b82-050d540604b4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:27.462558 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-20043998-c559-477f-9b82-050d540604b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:27.533439 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 26/51] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:27.600925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d54fb-7b15-4a66-b6ac-c029cf811871 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:27.663641 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:27.664939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:27.665382 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:27.665882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:27.667088 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:27.667679 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:27.670398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:27.685880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 26/52] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:27.691843 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20043998-c559-477f-9b82-050d540604b4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:27.793421 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20043998-c559-477f-9b82-050d540604b4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:27.828379 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:27.829022 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:27.829305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:27.829585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] PATH_INFO: `/v3/users/2693edda8d0d489e8bc6601783092eda` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:27.830755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] RBAC: Authorizing `identity:get_user(user_id=2693edda8d0d489e8bc6601783092eda)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:27.832196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:27.833995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 27/53] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:27 2022] GET /identity/v3/users/2693edda8d0d489e8bc6601783092eda => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:27.840100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:27.886892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:27.890639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:27.924475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:27.962846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee69d-baea-48ba-8e18-fba44ad0a41f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:28.004732 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:28.005517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:28.005919 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:28.006283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:28.007649 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:28.009592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:28.011459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 27/54] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:28.020123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:28.130343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d14c5-61ff-4d2c-8eee-1d1bc4dffeab None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:28.140558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e555-e28e-4d63-9d42-939148338877 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:28.169830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:28.170592 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:28.170982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:28.171341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:28.172584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:28.174479 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:28.176283 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:28.185012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9258b3b-8b2b-4d9c-b545-c46ae49f859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:28.185484 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:28.185990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258b3b-8b2b-4d9c-b545-c46ae49f859b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:28.186443 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258b3b-8b2b-4d9c-b545-c46ae49f859b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:28.186880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258b3b-8b2b-4d9c-b545-c46ae49f859b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:28.188120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9258b3b-8b2b-4d9c-b545-c46ae49f859b None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.domain.id=default, user.id=2693edda8d0d489e8bc6601783092eda) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:28.188656 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9258b3b-8b2b-4d9c-b545-c46ae49f859b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:28.191157 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9258b3b-8b2b-4d9c-b545-c46ae49f859b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:28.202019 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Sep 22 02:31:28 2022] GET /identity/v3/role_assignments?user.id=2693edda8d0d489e8bc6601783092eda&scope.domain.id=default&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 530 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:28.279687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:28.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e936625-9a38-46a1-b6d0-01c9b1fa4518 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:28.358037 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec614a-b223-466d-b1fa-feca14cb901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:28.358794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec614a-b223-466d-b1fa-feca14cb901e None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:28.359163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec614a-b223-466d-b1fa-feca14cb901e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:28.359536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec614a-b223-466d-b1fa-feca14cb901e None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:28.360309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec614a-b223-466d-b1fa-feca14cb901e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:28.361983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec614a-b223-466d-b1fa-feca14cb901e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:28.394902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 29/57] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Sep 22 02:31:28 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:31:30.630776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640583fd-1af2-40bd-ae4f-ca48a9bcbd09 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:30.631321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640583fd-1af2-40bd-ae4f-ca48a9bcbd09 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:30.631321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640583fd-1af2-40bd-ae4f-ca48a9bcbd09 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:30.632758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 29/58] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:30.640696 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f5067-b94a-40c2-9c0d-578a77efb9aa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:30.641247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f5067-b94a-40c2-9c0d-578a77efb9aa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:30.641613 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f5067-b94a-40c2-9c0d-578a77efb9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:30.664018 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-256f5067-b94a-40c2-9c0d-578a77efb9aa None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:30.665568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-256f5067-b94a-40c2-9c0d-578a77efb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:30.748685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 30/59] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:31.027394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640583fd-1af2-40bd-ae4f-ca48a9bcbd09 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:31.030420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:31.135341 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640583fd-1af2-40bd-ae4f-ca48a9bcbd09 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:31.170284 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d401a-03d8-434f-a849-cefb5dad94a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:31.170921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d401a-03d8-434f-a849-cefb5dad94a3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:31.171204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d401a-03d8-434f-a849-cefb5dad94a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:31.171483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d401a-03d8-434f-a849-cefb5dad94a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:31.172720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d401a-03d8-434f-a849-cefb5dad94a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:31.174202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d401a-03d8-434f-a849-cefb5dad94a3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:31.175777 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:31.181938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f5067-b94a-40c2-9c0d-578a77efb9aa None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:31.233452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:31.281797 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f5067-b94a-40c2-9c0d-578a77efb9aa None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:31.316247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c639a-974f-47a6-a2be-d139b418e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:31.316869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c639a-974f-47a6-a2be-d139b418e689 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:31.317154 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c639a-974f-47a6-a2be-d139b418e689 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:31.317438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c639a-974f-47a6-a2be-d139b418e689 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:31.318138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c639a-974f-47a6-a2be-d139b418e689 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:31.319599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c639a-974f-47a6-a2be-d139b418e689 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:31.346111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:31:31 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:31:34.811898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084977-901c-47a2-9aa1-c319b2602aed None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:34.812836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084977-901c-47a2-9aa1-c319b2602aed None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:34.813257 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084977-901c-47a2-9aa1-c319b2602aed None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:34.814883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 31/62] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:34.823934 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0d3a-4117-48cc-9b1a-21a1f2f2039f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:34.825315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0d3a-4117-48cc-9b1a-21a1f2f2039f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:34.826073 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0d3a-4117-48cc-9b1a-21a1f2f2039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:34.862977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fa4c0d3a-4117-48cc-9b1a-21a1f2f2039f None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:34.864943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fa4c0d3a-4117-48cc-9b1a-21a1f2f2039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:34.933770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fb035-9130-4acf-8ba2-924d386b4f9c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:34.933770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fb035-9130-4acf-8ba2-924d386b4f9c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:34.933770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fb035-9130-4acf-8ba2-924d386b4f9c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:34.934821 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:31:34.943197 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7db6a7-880a-4ffd-88a1-4db1a1d7f798 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:34.943874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7db6a7-880a-4ffd-88a1-4db1a1d7f798 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:34.945058 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7db6a7-880a-4ffd-88a1-4db1a1d7f798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:34.984499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7f7db6a7-880a-4ffd-88a1-4db1a1d7f798 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:34.988625 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7f7db6a7-880a-4ffd-88a1-4db1a1d7f798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:35.007463 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 32/64] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:35.102193 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:35.107993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 33/65] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:35.301443 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db10-6fdd-4486-9df1-50fd24fdba24 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.302131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db10-6fdd-4486-9df1-50fd24fdba24 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.302642 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db10-6fdd-4486-9df1-50fd24fdba24 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.304300 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 33/66] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:35.310629 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5111e6-3177-4d26-bc8f-b4039b8e3ad9 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.311256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5111e6-3177-4d26-bc8f-b4039b8e3ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.311729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5111e6-3177-4d26-bc8f-b4039b8e3ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.336617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ec5111e6-3177-4d26-bc8f-b4039b8e3ad9 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:35.338232 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ec5111e6-3177-4d26-bc8f-b4039b8e3ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:35.423945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763db10-6fdd-4486-9df1-50fd24fdba24 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:35.446067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 34/67] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:35.447629 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda67fb-5f3e-4d4d-9dfe-9d2cbd08594a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.447924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda67fb-5f3e-4d4d-9dfe-9d2cbd08594a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.448251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda67fb-5f3e-4d4d-9dfe-9d2cbd08594a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.449964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 35/68] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:35.458303 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3ddf6-a8d0-4da3-aa40-0c2cdaeeb4df None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.458804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3ddf6-a8d0-4da3-aa40-0c2cdaeeb4df None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.459254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3ddf6-a8d0-4da3-aa40-0c2cdaeeb4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.490501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:35.491830 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-97b3ddf6-a8d0-4da3-aa40-0c2cdaeeb4df None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:35.493304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-97b3ddf6-a8d0-4da3-aa40-0c2cdaeeb4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:35.557027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763db10-6fdd-4486-9df1-50fd24fdba24 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:35.581209 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 36/69] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:35.582829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ef2c7-d8dd-460d-8aad-94ce25bfa2e0 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.583328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ef2c7-d8dd-460d-8aad-94ce25bfa2e0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.583801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ef2c7-d8dd-460d-8aad-94ce25bfa2e0 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.585467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 37/70] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:35.586379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ef2c7-d8dd-460d-8aad-94ce25bfa2e0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:35.593090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3a109-be17-40cb-a521-7f02aac97a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:35.593757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3a109-be17-40cb-a521-7f02aac97a19 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.594039 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3a109-be17-40cb-a521-7f02aac97a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.594310 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3a109-be17-40cb-a521-7f02aac97a19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.606685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3a109-be17-40cb-a521-7f02aac97a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ded3a109-be17-40cb-a521-7f02aac97a19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:35.611743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:35.612587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:35.613335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:35.617803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 34/71] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:31:35.621613 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c9a8-36a1-4a25-8791-a9011833394e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.621952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c9a8-36a1-4a25-8791-a9011833394e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.622227 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c9a8-36a1-4a25-8791-a9011833394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.641062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7fe7c9a8-36a1-4a25-8791-a9011833394e None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:35.642298 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7fe7c9a8-36a1-4a25-8791-a9011833394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:35.670943 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:35.726469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ef2c7-d8dd-460d-8aad-94ce25bfa2e0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:35.727474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 35/72] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:35.728259 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7c9a8-36a1-4a25-8791-a9011833394e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:35.757062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:35.779161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:35.780636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.781217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.781710 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.796157 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:35.802816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:35.803691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:35.804433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:35.808180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 38/73] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:35.809200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:35.843381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7c9a8-36a1-4a25-8791-a9011833394e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:35.878934 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:35.879664 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.879832 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.880090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.880752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:35.881053 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:35.882454 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:35.892159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 36/74] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:35.892980 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:35.932405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ed44-5b75-41c3-af14-13383281c506 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:35.952591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:35.967972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:35.968626 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:35.968911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:35.969188 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:35.979807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:35.984681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:35.985511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 39/75] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:31:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:35.990401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:35.999157 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.009375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f618fa4-2944-4a9f-b016-76d5c00ba18e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.044908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.045534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.045854 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.046130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.046801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:36.047108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.048471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.056413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 37/76] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:36.057224 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.093033 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b54d9d-e600-4b0d-b257-723fd8f59dec None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.139906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.140648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.141046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.141421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.142904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.144368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.145963 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 40/77] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:36.150452 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.175305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360be4-45d9-472d-817e-df05cb6508bc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.210135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.216571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.217313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.217598 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.217910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.233920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.235392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.237078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 38/78] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:36.238534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.251447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.267706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3ab8-be6e-4eaf-84e0-e67e1e2c43d6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.310199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.310828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.311113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.311380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.312052 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:36.312359 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.314010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.323038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 41/79] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:36.324442 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.352685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e54445-c4fc-46bc-8ccf-6bba33cc5f99 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.388940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.389578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.389889 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.390163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.400375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:36.405908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:36.406924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:36.407691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 39/80] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:36.408304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.431474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a307212-4038-43da-8154-f0887b6c1054 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.441943 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.466961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.467592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.467867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.468140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] PATH_INFO: `/v3/users/2693edda8d0d489e8bc6601783092eda` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.469261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] RBAC: Authorizing `identity:get_user(user_id=2693edda8d0d489e8bc6601783092eda)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.470748 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.472518 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 42/81] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/users/2693edda8d0d489e8bc6601783092eda => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:36.473075 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.478013 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.508142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68fabd-9962-4654-bb15-3eda514bab5f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.541669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.542817 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.543101 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.543374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.544021 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.545460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.566643 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 40/82] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:31:36 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:31:36.567480 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.577093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466737bf-65b3-43b7-ae33-a94b236282d9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.621618 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.622347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.622717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.623070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.684929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.711002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.712983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.715892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d00439-25aa-48c0-acb4-0b655154efb2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.748067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.759903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.760559 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.760877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.761158 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.762379 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.763842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.770856 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 41/83] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:36.771016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.829719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 43/84] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:36.830868 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:36.911799 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419da7e-ed14-4c4b-8775-dc264ec368c6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.932856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:36.956193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:36.956424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546a45c-0c8a-4d88-a844-b0ffcb83ad06 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:36.956823 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:36.957109 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:36.957460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:36.958124 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:36.958431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:36.959839 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:36.971986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 42/85] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:36.973204 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.000961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.001717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.002082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.002420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.053115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:37.082000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.083682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.105935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3307c3b-faf2-4581-929d-b7e04c427fa3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.144200 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.145168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.145679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.146132 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.165625 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:37.190769 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 44/86] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:37.191549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.236738 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.238638 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.299084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b6952-32b6-4e9d-86c1-05877d2c0f0d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.304089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:37.350539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.351683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.352492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.353167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.355357 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.357696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.359861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 45/87] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:37.361006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.362138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 43/88] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:37.363147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.427998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:37.487156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c500b-99ef-4782-ba4a-4ebce78e3e29 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.502858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec751a-3ba9-4e3d-8d67-9867a876317c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.525681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.526584 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.526965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.527703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.528690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.530340 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.532244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 46/89] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:37.533112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.545382 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.546434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.546940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.547399 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.548857 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.550503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.552560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 44/90] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:37.553608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.589804 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:37.650182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f906813-44c9-4bcf-b984-e80281a98688 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.665800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:37.686720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efa79f-3747-4dd4-93b4-0396cbd35b64 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.690238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.690561 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.690944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.691318 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.692166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=0d8f08b6a27347c1b6a0be2724b6aed0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:37.692582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.694263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.701474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 47/91] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/role_assignments?user.id=0d8f08b6a27347c1b6a0be2724b6aed0&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:37.706788 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.740795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.742872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.743533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.744733 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.747887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.751042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.756805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 45/92] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:37.758367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:37.879651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:37.891876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a77c83-3b28-4a5d-99fb-3d7f954dfe3e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.932681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2447db9-3c38-4aee-b388-4a79aa47d486 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:37.933725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:37.934981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:37.937267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:37.937820 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:37.938836 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=2693edda8d0d489e8bc6601783092eda) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:37.939647 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:37.942018 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:37.952031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 46/93] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/role_assignments?user.id=2693edda8d0d489e8bc6601783092eda&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:37.953367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:38.051418 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:38.051970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:38.052246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:38.052516 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:38.078426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5b930-017d-4a15-ac0f-5851899dacfa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:38.125219 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa226d-37de-4079-8534-797b0214317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:38.127576 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa226d-37de-4079-8534-797b0214317d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:38.128954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa226d-37de-4079-8534-797b0214317d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:38.129565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa226d-37de-4079-8534-797b0214317d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:38.130703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa226d-37de-4079-8534-797b0214317d None admin] RBAC: Adding query filter params (role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=0d8f08b6a27347c1b6a0be2724b6aed0) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:38.132121 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa226d-37de-4079-8534-797b0214317d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:38.134552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa226d-37de-4079-8534-797b0214317d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:38.149431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 47/94] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/role_assignments?user.id=0d8f08b6a27347c1b6a0be2724b6aed0&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:38.165545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:38.198673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:38.200599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:38.335349 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 48/95] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:38.342352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa226d-37de-4079-8534-797b0214317d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:38.375109 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:38.482536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa226d-37de-4079-8534-797b0214317d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:38.534878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176bff7-22ff-450a-a198-58609b7f63ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:38.535927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176bff7-22ff-450a-a198-58609b7f63ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:38.536423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176bff7-22ff-450a-a198-58609b7f63ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:38.536895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176bff7-22ff-450a-a198-58609b7f63ec None admin] PATH_INFO: `/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:38.543289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176bff7-22ff-450a-a198-58609b7f63ec None admin] RBAC: Authorizing `identity:get_project(project_id=ee7ccf62c1624ecaae04fe78d935d45d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:38.544906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176bff7-22ff-450a-a198-58609b7f63ec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:38.547052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 48/96] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:38 2022] GET /identity/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:38.552613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:38.680695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:38.714667 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc121ef-0bfe-4a55-a516-eb9b313e2e72 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:38.771026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6df2c-c807-4516-ac91-c307aecfa5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:38.771564 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6df2c-c807-4516-ac91-c307aecfa5e3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:38.771860 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6df2c-c807-4516-ac91-c307aecfa5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:38.772125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6df2c-c807-4516-ac91-c307aecfa5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:38.772869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6df2c-c807-4516-ac91-c307aecfa5e3 None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=ee7ccf62c1624ecaae04fe78d935d45d, user.id=0d8f08b6a27347c1b6a0be2724b6aed0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:38.773184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6df2c-c807-4516-ac91-c307aecfa5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:38.774779 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6df2c-c807-4516-ac91-c307aecfa5e3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:38.786306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 49/97] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:38 2022] GET /identity/v3/role_assignments?user.id=0d8f08b6a27347c1b6a0be2724b6aed0&scope.project.id=ee7ccf62c1624ecaae04fe78d935d45d&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:39.463211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478a63-b02e-43e3-8a0b-071cbeda1a91 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:39.464297 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478a63-b02e-43e3-8a0b-071cbeda1a91 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:39.464786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478a63-b02e-43e3-8a0b-071cbeda1a91 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:39.466432 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 49/98] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:39.472403 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48cef9-3ebf-4328-883a-b81fd8f70dec None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:39.472922 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48cef9-3ebf-4328-883a-b81fd8f70dec None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:39.472995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48cef9-3ebf-4328-883a-b81fd8f70dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:39.503569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0e48cef9-3ebf-4328-883a-b81fd8f70dec None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:39.504813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0e48cef9-3ebf-4328-883a-b81fd8f70dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:39.603128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 50/99] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:39.633514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406a54d-7dfd-4814-b399-572d25189e67 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:39.634218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406a54d-7dfd-4814-b399-572d25189e67 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:39.634698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406a54d-7dfd-4814-b399-572d25189e67 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:39.636404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 50/100] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:39.642288 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474a9e-e901-474b-ab01-8399ff8d89a6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:39.642574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474a9e-e901-474b-ab01-8399ff8d89a6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:39.642858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474a9e-e901-474b-ab01-8399ff8d89a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:39.670331 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f6474a9e-e901-474b-ab01-8399ff8d89a6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:39.671959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f6474a9e-e901-474b-ab01-8399ff8d89a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:39.768129 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 51/101] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:40.144378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406a54d-7dfd-4814-b399-572d25189e67 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:40.296240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474a9e-e901-474b-ab01-8399ff8d89a6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:40.299630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:40.386603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:40.417363 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406a54d-7dfd-4814-b399-572d25189e67 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:40.512649 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:40.513643 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:40.513643 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:40.513891 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:40.514236 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474a9e-e901-474b-ab01-8399ff8d89a6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:40.562564 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:40.562852 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:40.563419 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:40.563708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:40.563980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:40.566346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:40.567924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:40.568608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:40.570290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:40.571770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 51/102] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:40.577083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 52/103] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:40.582928 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:40.583360 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:40.691621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:40.750555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebbb50-90b9-4d0f-9672-4b1e05fa01f1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:40.830971 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:40.831601 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:40.831880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:40.832158 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:40.832840 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:40.833146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:40.834551 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:40.852921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 53/104] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:40.862385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:40.891377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ebbca-8c95-485f-a673-e390497fdf47 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:40.971579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:40.972231 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:40.972524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:40.972856 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:40.973492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:40.975112 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:41.039407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:41.050205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 52/105] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:31:40 2022] POST /identity/v3/projects => generated 302 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:31:41.071715 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3fcc8-531a-40ae-8f38-f45e74978b22 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:41.126466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:41.131100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e24c1b-9cfa-4109-9433-a4d0465eb0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:41.131845 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e24c1b-9cfa-4109-9433-a4d0465eb0cd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.132136 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e24c1b-9cfa-4109-9433-a4d0465eb0cd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.132580 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e24c1b-9cfa-4109-9433-a4d0465eb0cd None admin] PATH_INFO: `/v3/users/6f5f6bc0c1014c3badf8b2d43e96bfaf` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:41.158405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e24c1b-9cfa-4109-9433-a4d0465eb0cd None admin] RBAC: Authorizing `identity:get_user(user_id=6f5f6bc0c1014c3badf8b2d43e96bfaf)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:41.159935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e24c1b-9cfa-4109-9433-a4d0465eb0cd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:41.161735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 54/106] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:40 2022] GET /identity/v3/users/6f5f6bc0c1014c3badf8b2d43e96bfaf => generated 289 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:41.171442 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:41.346011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ad7c-e898-4cb9-97a3-96787d313b12 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:41.400726 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee0d9e-f4a0-4e1d-9d50-7ebed4466f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:41.401871 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0d9e-f4a0-4e1d-9d50-7ebed4466f66 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.402390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0d9e-f4a0-4e1d-9d50-7ebed4466f66 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.402781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0d9e-f4a0-4e1d-9d50-7ebed4466f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:41.493731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:41.499228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee0d9e-f4a0-4e1d-9d50-7ebed4466f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:41.500890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee0d9e-f4a0-4e1d-9d50-7ebed4466f66 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:41.624166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1f83-0490-4081-96c1-a9fada3cea15 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.624788 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1f83-0490-4081-96c1-a9fada3cea15 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.624788 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1f83-0490-4081-96c1-a9fada3cea15 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:41.627924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 53/107] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:41.631382 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 55/108] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:41.634191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dac0e-25fc-4513-be02-2da601389e49 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.634490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dac0e-25fc-4513-be02-2da601389e49 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.634758 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dac0e-25fc-4513-be02-2da601389e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:41.641343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d1f83-0490-4081-96c1-a9fada3cea15 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:41.666617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-757dac0e-25fc-4513-be02-2da601389e49 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:41.668353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-757dac0e-25fc-4513-be02-2da601389e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:41.783782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 54/109] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:41.786621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d6daa-3c15-4064-bc80-503e4885f885 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.787413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d6daa-3c15-4064-bc80-503e4885f885 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.788202 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d6daa-3c15-4064-bc80-503e4885f885 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:41.791323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 55/110] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:41.794952 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d1f83-0490-4081-96c1-a9fada3cea15 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:41.798324 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577948ac-c716-4272-be21-13a8b7ff74ed None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.799204 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577948ac-c716-4272-be21-13a8b7ff74ed None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.799975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577948ac-c716-4272-be21-13a8b7ff74ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:41.834440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-577948ac-c716-4272-be21-13a8b7ff74ed None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:41.836406 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-577948ac-c716-4272-be21-13a8b7ff74ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:41.836901 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:41.841695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.841695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.841695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:41.844204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:41.846920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:41.854101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 56/111] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:41 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:41.855672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:41.902145 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:41.926899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:41.973272 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889ef9-706d-4edf-ad3c-865b864f306a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:41.996044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 56/112] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:41.997754 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721253-9d07-4ba4-a4c6-e762ab9f50a0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:41.998242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721253-9d07-4ba4-a4c6-e762ab9f50a0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:41.998733 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721253-9d07-4ba4-a4c6-e762ab9f50a0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:42.006158 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 57/113] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:42.007921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e60b0-cdca-4cb2-a621-769fb7fe8f9b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:42.008489 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e60b0-cdca-4cb2-a621-769fb7fe8f9b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:42.009006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e60b0-cdca-4cb2-a621-769fb7fe8f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:42.017757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:42.018384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:42.018662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:42.018931 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:42.019675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] RBAC: Adding query filter params (role.id=80ad5d7540594fb487d2f2b65c7e7532, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=6f5f6bc0c1014c3badf8b2d43e96bfaf) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:42.019981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:42.023304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:42.035505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 57/114] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:41 2022] GET /identity/v3/role_assignments?user.id=6f5f6bc0c1014c3badf8b2d43e96bfaf&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=80ad5d7540594fb487d2f2b65c7e7532 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:42.050206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-752e60b0-cdca-4cb2-a621-769fb7fe8f9b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:42.051412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-752e60b0-cdca-4cb2-a621-769fb7fe8f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:42.163220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 58/115] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:42.271221 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:42.403287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee69b44-cb8b-4d07-8e84-1245061bac87 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:42.428304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:42.442875 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:42.443570 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:42.443893 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:42.444177 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:42.463008 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:42.463250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e60b0-cdca-4cb2-a621-769fb7fe8f9b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:42.471009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:42.473120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:42.475026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 58/116] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:42.478562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:42.656852 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6051-2a2d-4b4b-b6eb-05709f290ffe None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:42.696587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:42.709447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:42.710921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:42.711214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:42.711490 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:42.712178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:42.712485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:42.717905 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:42.720627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e60b0-cdca-4cb2-a621-769fb7fe8f9b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:42.739673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 59/117] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:42.743510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:42.805132 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:42.806092 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:42.806382 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:42.806657 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:42.835684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:42.845339 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:42.845585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:42.847184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:42.848445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:42.850992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 59/118] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:31:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:42.850992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:42.978368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4d96-96c4-4694-8dd8-36b70afdfee0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:43.033386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:43.034267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.034859 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.035323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.051386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:43.057124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:43.059465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 60/119] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:31:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:43.060982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:43.081284 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319ea0c-212e-4e9f-a318-d64a4087ddb9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:43.158845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6b00-4bad-4809-ae97-78b6632246e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:43.160749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6b00-4bad-4809-ae97-78b6632246e0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.161496 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6b00-4bad-4809-ae97-78b6632246e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.162552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6b00-4bad-4809-ae97-78b6632246e0 None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.166421 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd6b00-4bad-4809-ae97-78b6632246e0 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:43.170788 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd6b00-4bad-4809-ae97-78b6632246e0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:43.174795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 60/120] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:42 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:43.177624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1798b-f153-4fa6-affa-b0f11553d183 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.178432 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1798b-f153-4fa6-affa-b0f11553d183 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.179019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1798b-f153-4fa6-affa-b0f11553d183 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.182976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 61/121] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:43.184936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1798b-f153-4fa6-affa-b0f11553d183 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:43.229501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:43.279890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a0c8e-10a1-4f56-a689-574c76591d8b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:43.286062 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:43.345919 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71921069-ea87-4dec-bfe8-ffe8bd1a46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:43.346961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921069-ea87-4dec-bfe8-ffe8bd1a46e7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.347461 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921069-ea87-4dec-bfe8-ffe8bd1a46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.347959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921069-ea87-4dec-bfe8-ffe8bd1a46e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.349336 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71921069-ea87-4dec-bfe8-ffe8bd1a46e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:43.349825 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71921069-ea87-4dec-bfe8-ffe8bd1a46e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:43.352574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71921069-ea87-4dec-bfe8-ffe8bd1a46e7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:43.370033 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 61/122] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:43.378686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78b27-1416-45ce-ab88-50bf74b8aff3 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.378686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78b27-1416-45ce-ab88-50bf74b8aff3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.378686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78b27-1416-45ce-ab88-50bf74b8aff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.398437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1798b-f153-4fa6-affa-b0f11553d183 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:43.405369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-93c78b27-1416-45ce-ab88-50bf74b8aff3 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:43.407280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-93c78b27-1416-45ce-ab88-50bf74b8aff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:43.460872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:43.462328 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.462604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.462976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.464333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:43.464703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:43.466395 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:43.477264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 62/123] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:31:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:43.478292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:43.517937 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 62/124] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:43.519929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c78b27-1416-45ce-ab88-50bf74b8aff3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:43.639906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:43.648234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c78b27-1416-45ce-ab88-50bf74b8aff3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:43.690083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:43.691517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.692017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.692478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] PATH_INFO: `/v3/users/2693edda8d0d489e8bc6601783092eda` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.693898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] RBAC: Authorizing `identity:get_user(user_id=2693edda8d0d489e8bc6601783092eda)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:43.696279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:43.698319 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 63/125] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:43 2022] GET /identity/v3/users/2693edda8d0d489e8bc6601783092eda => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:43.699501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:43.736625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:43.804133 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c3487-b094-455a-be98-da09a9127f85 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:43.828525 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43d673-4100-4907-92a8-4c94458e191b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:43.892972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:43.894415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.895154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.895895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.898387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:43.901961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:43.904733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 64/126] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:43 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:43.906607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:43.907305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:43.907971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:43.908258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:43.908536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:43.912420 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:43.915238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:43.916082 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 63/127] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:43 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:43.916945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:43.977516 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:44.133546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793799ac-6190-46a1-875a-8c7aee60dfaf None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:44.140953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bde87-3a6d-4bc3-bd4a-e188f5a12293 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:44.188096 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:44.188298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:44.188756 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.189040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.189321 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.189900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.190284 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.190661 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.191000 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:44.192038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:44.192903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:44.193747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:44.194995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 64/128] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:43 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:44.195707 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 65/129] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:43 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:44.196066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:44.196979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:44.232921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:44.338937 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:44.342611 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ed58-e61e-47c0-a4df-3a7a69f4fd42 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:44.343819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a6c76-d743-4b64-9977-015f1ec560ae None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:44.392431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:44.393543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.393776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.394057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.398144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:44.398816 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.399264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.399667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c/users/0d8f08b6a27347c1b6a0be2724b6aed0/roles/c5260227d3ff4cbf956c47e3590a0ba1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.410071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] RBAC: Authorizing `identity:create_grant(project_id=33030c4724a540db9ef3256cf305f68c, user_id=0d8f08b6a27347c1b6a0be2724b6aed0, role_id=c5260227d3ff4cbf956c47e3590a0ba1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:44.410071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:44.410424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:44.412940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:44.415379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:44.416949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:44.420041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 66/130] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:44.423300 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:44.423527 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 65/131] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:31:44 2022] PUT /identity/v3/projects/33030c4724a540db9ef3256cf305f68c/users/0d8f08b6a27347c1b6a0be2724b6aed0/roles/c5260227d3ff4cbf956c47e3590a0ba1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:31:44.424141 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:44.542972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:44.598481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc5f38-6d6f-487c-a3c7-1b33ca1cb08d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:44.646169 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8df6ec-303d-4e3f-8c16-34cb23052aba None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:44.657053 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511ba58-ccef-4a56-b324-5177799e950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:44.657887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511ba58-ccef-4a56-b324-5177799e950c None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.658177 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511ba58-ccef-4a56-b324-5177799e950c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.658463 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511ba58-ccef-4a56-b324-5177799e950c None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c/users/2693edda8d0d489e8bc6601783092eda/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.662274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511ba58-ccef-4a56-b324-5177799e950c None admin] RBAC: Authorizing `identity:create_grant(project_id=33030c4724a540db9ef3256cf305f68c, user_id=2693edda8d0d489e8bc6601783092eda, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:44.663766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511ba58-ccef-4a56-b324-5177799e950c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:44.679779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 66/132] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:31:44 2022] PUT /identity/v3/projects/33030c4724a540db9ef3256cf305f68c/users/2693edda8d0d489e8bc6601783092eda/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:31:44.681598 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503630f6-2ba4-43fc-ac07-a163b5364530 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.682015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503630f6-2ba4-43fc-ac07-a163b5364530 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.682958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503630f6-2ba4-43fc-ac07-a163b5364530 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.684326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 67/133] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:44.686241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503630f6-2ba4-43fc-ac07-a163b5364530 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:44.713629 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b547bb2-654b-4da6-8bac-90b79d4b37fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:44.715745 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547bb2-654b-4da6-8bac-90b79d4b37fd None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.716612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547bb2-654b-4da6-8bac-90b79d4b37fd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.717414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547bb2-654b-4da6-8bac-90b79d4b37fd None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c/users/0d8f08b6a27347c1b6a0be2724b6aed0/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.721770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b547bb2-654b-4da6-8bac-90b79d4b37fd None admin] RBAC: Authorizing `identity:create_grant(project_id=33030c4724a540db9ef3256cf305f68c, user_id=0d8f08b6a27347c1b6a0be2724b6aed0, role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:44.724853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b547bb2-654b-4da6-8bac-90b79d4b37fd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:44.764435 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 67/134] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:31:44 2022] PUT /identity/v3/projects/33030c4724a540db9ef3256cf305f68c/users/0d8f08b6a27347c1b6a0be2724b6aed0/roles/80756a2a2a9a47918e65c4ed873146eb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:31:44.766244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07efae-d145-4f85-bb14-a77cb7bd3941 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:44.766767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07efae-d145-4f85-bb14-a77cb7bd3941 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:44.767252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07efae-d145-4f85-bb14-a77cb7bd3941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:44.806928 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ca07efae-d145-4f85-bb14-a77cb7bd3941 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:44.809093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ca07efae-d145-4f85-bb14-a77cb7bd3941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:44.834838 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:44.875690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503630f6-2ba4-43fc-ac07-a163b5364530 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:44.965445 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 68/135] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:45.011773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:45.012446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:45.012737 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:45.013019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:45.013795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:45.014112 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:45.015624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:45.027392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:45.035171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 68/136] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:45.040674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07efae-d145-4f85-bb14-a77cb7bd3941 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:45.173615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07efae-d145-4f85-bb14-a77cb7bd3941 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:45.214712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574cc4e-4cea-4112-941d-f134599fe825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:45.215396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574cc4e-4cea-4112-941d-f134599fe825 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:45.215729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574cc4e-4cea-4112-941d-f134599fe825 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:45.215952 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574cc4e-4cea-4112-941d-f134599fe825 None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:45.217399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574cc4e-4cea-4112-941d-f134599fe825 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:45.219042 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574cc4e-4cea-4112-941d-f134599fe825 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:45.221157 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 69/137] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:45 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:45.226769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:45.280527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02ce9-557f-4fd8-a07a-18e229f03db6 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:45.280865 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02ce9-557f-4fd8-a07a-18e229f03db6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:45.281096 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02ce9-557f-4fd8-a07a-18e229f03db6 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:45.282673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 70/138] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:45.288854 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a33c-b704-4bee-ab5e-73b30c901bab None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:45.289406 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a33c-b704-4bee-ab5e-73b30c901bab None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:45.289787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a33c-b704-4bee-ab5e-73b30c901bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:45.310622 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e762a33c-b704-4bee-ab5e-73b30c901bab None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:45.311923 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e762a33c-b704-4bee-ab5e-73b30c901bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:45.329276 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:45.394023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 71/139] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:45.394924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a33c-b704-4bee-ab5e-73b30c901bab None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:45.461887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6098-2ee9-4244-9df4-db8dc3555962 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:45.599319 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:45.599906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:45.600195 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:45.600477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] PATH_INFO: `/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:45.602508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] RBAC: Authorizing `identity:get_project(project_id=ee7ccf62c1624ecaae04fe78d935d45d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:45.604050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:45.605821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 69/140] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:45 2022] GET /identity/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d => generated 312 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:45.626220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:45.732938 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a33c-b704-4bee-ab5e-73b30c901bab None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:45.806050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:45.841163 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:45.842255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:45.842729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:45.843255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:45.846760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:45.849408 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:45.852451 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 72/141] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:45.863683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:45.897431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:45.935731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8188-b1ff-44d5-98ef-ec53c7c28533 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:46.033861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:46.033861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:46.033861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:46.033861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] PATH_INFO: `/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d/users/0d8f08b6a27347c1b6a0be2724b6aed0/roles/c5260227d3ff4cbf956c47e3590a0ba1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:46.034285 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee7ccf62c1624ecaae04fe78d935d45d, user_id=0d8f08b6a27347c1b6a0be2724b6aed0, role_id=c5260227d3ff4cbf956c47e3590a0ba1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:46.036941 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:46.087005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 70/142] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:31:45 2022] PUT /identity/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d/users/0d8f08b6a27347c1b6a0be2724b6aed0/roles/c5260227d3ff4cbf956c47e3590a0ba1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:31:46.092603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:46.168988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38a31-c9a7-46bb-b738-b09cccb038b8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:46.316835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:46.317878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:46.318528 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:46.319031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:46.320437 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:46.323906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:46.400759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 73/143] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:31:45 2022] POST /identity/v3/users => generated 283 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:31:46.411382 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411d157-2814-4fb0-a973-2dc7bfe1e8b4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:46.482680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:46.483801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:46.484506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:46.485183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:46.486003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:46.508086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:46.518798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:46.519771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:31:46.520547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:46.521211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 71/144] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:46.531498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:46.712310 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:46.779390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8e64e-018a-44ae-8f4b-33dd47ffbdeb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:46.858283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:46.859235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:46.859669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:46.860088 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:46.861178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:46.861641 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:46.864022 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:46.884113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 74/145] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:46.893537 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:47.164326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf167f23-26de-4ec7-b32e-2bcf7d1bd2f8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:47.246628 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8856cb-009d-4baa-885b-05103b62f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:47.247762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8856cb-009d-4baa-885b-05103b62f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:47.248248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8856cb-009d-4baa-885b-05103b62f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:47.248746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8856cb-009d-4baa-885b-05103b62f0d8 None admin] PATH_INFO: `/v3/users/6f5f6bc0c1014c3badf8b2d43e96bfaf` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:47.252653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8856cb-009d-4baa-885b-05103b62f0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6f5f6bc0c1014c3badf8b2d43e96bfaf)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:47.255614 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8856cb-009d-4baa-885b-05103b62f0d8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:47.259214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 72/146] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:46 2022] GET /identity/v3/users/6f5f6bc0c1014c3badf8b2d43e96bfaf => generated 289 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:47.269147 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:47.386392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1b18-2a0d-4bb8-a63e-ec8f89173760 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:47.386859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1b18-2a0d-4bb8-a63e-ec8f89173760 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:47.387340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1b18-2a0d-4bb8-a63e-ec8f89173760 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:47.395458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 73/147] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:47.401369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12cbe-549e-4b71-b5b4-9a34ea4592f1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:47.401631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12cbe-549e-4b71-b5b4-9a34ea4592f1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:47.402013 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12cbe-549e-4b71-b5b4-9a34ea4592f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:47.446759 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-abf12cbe-549e-4b71-b5b4-9a34ea4592f1 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:47.448584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-abf12cbe-549e-4b71-b5b4-9a34ea4592f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:47.483794 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed90ecd-1b1a-4771-8f71-cd31fff1693c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:47.559331 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:47.560326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:47.560788 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:47.561246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:47.563327 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:47.565752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:47.573810 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 75/148] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:47 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:47.579105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:47.590069 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:47.601517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:47.687344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 74/149] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:47.830665 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17e26-6f0a-48e3-8fa5-f6fd9bffa1e5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:47.898281 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:47.899425 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:47.899904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:47.900394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c/users/6f5f6bc0c1014c3badf8b2d43e96bfaf/roles/80ad5d7540594fb487d2f2b65c7e7532` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:47.903649 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=33030c4724a540db9ef3256cf305f68c, user_id=6f5f6bc0c1014c3badf8b2d43e96bfaf, role_id=80ad5d7540594fb487d2f2b65c7e7532)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:47.906362 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:47.931972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 76/150] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:31:47 2022] PUT /identity/v3/projects/33030c4724a540db9ef3256cf305f68c/users/6f5f6bc0c1014c3badf8b2d43e96bfaf/roles/80ad5d7540594fb487d2f2b65c7e7532 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:31:48.262226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf12cbe-549e-4b71-b5b4-9a34ea4592f1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:48.423611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf12cbe-549e-4b71-b5b4-9a34ea4592f1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:48.490259 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:48.491289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:48.491768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:48.492244 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:48.511036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:48.519427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:48.521076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:48.522365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 75/151] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:48.531889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:48.686179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:48.743256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254098d7-d49b-4ece-9a7b-023121037d79 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:48.786545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:48.787148 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:48.787516 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:48.787955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:48.788641 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:48.788948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:48.790629 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:48.803959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 77/152] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:48.813396 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:48.882075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:48.950140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930c23d-eeb9-4d3f-b38a-d2b54164a2b3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:48.989067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121994a-d9f5-4237-9f83-690184a68fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:48.989820 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121994a-d9f5-4237-9f83-690184a68fdc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:48.990105 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121994a-d9f5-4237-9f83-690184a68fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:48.990387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121994a-d9f5-4237-9f83-690184a68fdc None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:48.991602 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121994a-d9f5-4237-9f83-690184a68fdc None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:48.993090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121994a-d9f5-4237-9f83-690184a68fdc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:48.995374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 76/153] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:48 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:49.004396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:49.127659 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694a59-5b43-43d1-a691-f06122ecff3c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:49.180049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:49.211113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8cd2-be77-4c43-8ba7-bb4c558a62db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:49.212639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8cd2-be77-4c43-8ba7-bb4c558a62db None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:49.213475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8cd2-be77-4c43-8ba7-bb4c558a62db None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:49.214288 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8cd2-be77-4c43-8ba7-bb4c558a62db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:49.400996 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8cd2-be77-4c43-8ba7-bb4c558a62db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:49.404105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8cd2-be77-4c43-8ba7-bb4c558a62db None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:49.468105 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4911690-3b54-4b31-ba48-560b7bdd0c2b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:49.469089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4911690-3b54-4b31-ba48-560b7bdd0c2b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:49.469564 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4911690-3b54-4b31-ba48-560b7bdd0c2b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:49.471413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 77/154] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:49.477170 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a222-3402-46b1-b16c-a6f2e7b83a19 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:49.477735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a222-3402-46b1-b16c-a6f2e7b83a19 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:49.478235 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a222-3402-46b1-b16c-a6f2e7b83a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:49.518504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-78a4a222-3402-46b1-b16c-a6f2e7b83a19 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:49.520119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-78a4a222-3402-46b1-b16c-a6f2e7b83a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:49.594517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 78/155] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 22 02:31:49.684137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 78/156] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:49.690239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4a222-3402-46b1-b16c-a6f2e7b83a19 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:49.754006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:49.801023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19de37-54f5-4450-b6aa-95d64e252f98 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:49.801706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19de37-54f5-4450-b6aa-95d64e252f98 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:49.802285 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19de37-54f5-4450-b6aa-95d64e252f98 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:49.803924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 79/157] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:31:49.810672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682905c6-28e1-4199-b520-327ef42ae66b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:49.811286 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682905c6-28e1-4199-b520-327ef42ae66b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:49.811769 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682905c6-28e1-4199-b520-327ef42ae66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:49.830536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4a222-3402-46b1-b16c-a6f2e7b83a19 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:49.854903 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-682905c6-28e1-4199-b520-327ef42ae66b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:49.856511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-682905c6-28e1-4199-b520-327ef42ae66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:49.869468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:49.870538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:49.870982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:49.871431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:49.873015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:49.874747 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:49.876655 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 79/158] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:49 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:49.882866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:49.888610 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:50.014197 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 80/159] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:50.037473 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1a89-8b16-418d-aabf-39144972f840 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:50.062050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:50.088954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:50.089591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:50.089900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:50.090236 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:50.090981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=0d8f08b6a27347c1b6a0be2724b6aed0) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:50.091342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:50.092796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:50.099910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 80/160] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:49 2022] GET /identity/v3/role_assignments?user.id=0d8f08b6a27347c1b6a0be2724b6aed0&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:50.174627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682905c6-28e1-4199-b520-327ef42ae66b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:50.313526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682905c6-28e1-4199-b520-327ef42ae66b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:50.355244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:50.356290 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:50.356786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:50.357266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:50.374549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:50.380090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:50.381025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:50.386308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:50.388594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 81/161] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:50.398345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:50.535753 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674fc74-6232-4ebb-ae81-976609c661ca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:50.557458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:50.580309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:50.580863 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:50.581203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:50.581491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:50.582212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:50.582519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:50.584736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:50.595971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 81/162] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:50.598577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:50.608253 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:50.657452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:50.752760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2250d-417f-4f4e-b18d-b7a8f62e1b58 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:50.801348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:50.802070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:50.802353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:50.802625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] PATH_INFO: `/v3/users/2693edda8d0d489e8bc6601783092eda` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:50.803808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] RBAC: Authorizing `identity:get_user(user_id=2693edda8d0d489e8bc6601783092eda)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:50.804102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68902-448a-42ac-962a-e79c6b17346c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:50.805309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:50.809951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 82/163] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:50 2022] GET /identity/v3/users/2693edda8d0d489e8bc6601783092eda => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:50.816114 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:50.871237 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:50.872373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:50.872875 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:50.873371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:50.897717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:50.904139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:50.905053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:50.905851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:50.908846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 82/164] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:31:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:50.915652 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:50.939641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376080b6-1225-43e6-8022-362c6d44061b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:50.942472 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:50.980990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:50.981766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:50.982057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:50.982334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:51.037625 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:51.069067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:51.075330 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:51.089208 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820e71-9a9f-4aa0-bcbd-5531676704e1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:51.167011 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f2804-193c-4461-8527-5cc344f3849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:51.169753 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f2804-193c-4461-8527-5cc344f3849e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:51.171981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f2804-193c-4461-8527-5cc344f3849e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:51.172512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f2804-193c-4461-8527-5cc344f3849e None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:51.173430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f2804-193c-4461-8527-5cc344f3849e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:51.175114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f2804-193c-4461-8527-5cc344f3849e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:51.178367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f2804-193c-4461-8527-5cc344f3849e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:51.201447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 83/165] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:31:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:51.204138 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f17a5-e25c-4652-92c5-d899df7eb530 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:51.206522 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f17a5-e25c-4652-92c5-d899df7eb530 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:51.207162 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f17a5-e25c-4652-92c5-d899df7eb530 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:51.210466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 84/166] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:51.216835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d53a-84b9-4bdd-afe3-1df62886df72 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:51.217480 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d53a-84b9-4bdd-afe3-1df62886df72 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:51.219203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d53a-84b9-4bdd-afe3-1df62886df72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:51.247739 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 83/167] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:31:51.248967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:51.263304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:51.274230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b883d53a-84b9-4bdd-afe3-1df62886df72 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:51.275175 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b883d53a-84b9-4bdd-afe3-1df62886df72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:51.476226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 85/168] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:51.477127 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883d53a-84b9-4bdd-afe3-1df62886df72 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:51.601193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614515cf-7281-4fe4-b0ae-b6d165f58eff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:51.664760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:51.722636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883d53a-84b9-4bdd-afe3-1df62886df72 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:51.761917 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:51.762913 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:51.763494 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:51.763884 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:51.771045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:51.773837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:51.777345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 84/169] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:51 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:51.783486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:51.787381 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:51.788044 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:51.788321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:51.788585 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:51.794552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:51.796087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:51.798087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 86/170] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:51 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:51.804262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:51.975589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdbb94-dcfd-4b8f-b9ec-f9857fbaa930 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:52.021387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:52.021956 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:52.022230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:52.022496 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:52.023242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=2693edda8d0d489e8bc6601783092eda) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:52.023548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:52.024999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:52.027568 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:52.038406 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 87/171] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:51 2022] GET /identity/v3/role_assignments?user.id=2693edda8d0d489e8bc6601783092eda&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:52.039341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:52.128871 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be3108-7c42-4c65-b50a-eef4709b6447 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:52.215534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:52.216628 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:52.217116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:52.217614 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:52.295416 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:52.348901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:52.351713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:52.552962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:52.566713 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110e195-2b5f-464f-930b-4e6d8875448f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:52.650888 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 85/172] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:31:52.656775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:52.675110 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0afd-1f2d-4db5-9eda-80b373301cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:52.676124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0afd-1f2d-4db5-9eda-80b373301cdf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:52.678662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0afd-1f2d-4db5-9eda-80b373301cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:52.679239 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0afd-1f2d-4db5-9eda-80b373301cdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:52.697589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0afd-1f2d-4db5-9eda-80b373301cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0b6f0afd-1f2d-4db5-9eda-80b373301cdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:52.704159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:52.705090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:52.705927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:52.708739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 88/173] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:31:52.714826 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2c155-4589-45fb-b052-2b985b736744 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:52.715548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2c155-4589-45fb-b052-2b985b736744 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:52.716027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2c155-4589-45fb-b052-2b985b736744 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:52.717683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 89/174] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:52.720736 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2c155-4589-45fb-b052-2b985b736744 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:52.843925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:52.890920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1c2a-e736-4d17-9044-02b160654876 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:52.951216 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2c155-4589-45fb-b052-2b985b736744 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:52.958139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3428ee-f3eb-4d1b-a61e-a48ab752169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:52.959296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3428ee-f3eb-4d1b-a61e-a48ab752169d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:52.959880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3428ee-f3eb-4d1b-a61e-a48ab752169d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:52.960300 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3428ee-f3eb-4d1b-a61e-a48ab752169d None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:52.962162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3428ee-f3eb-4d1b-a61e-a48ab752169d None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:52.964598 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3428ee-f3eb-4d1b-a61e-a48ab752169d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:52.967162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 86/175] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:52 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:52.969163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97eb8e-ef6e-418f-874e-93333a30b814 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:52.969641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97eb8e-ef6e-418f-874e-93333a30b814 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:52.970282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97eb8e-ef6e-418f-874e-93333a30b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.003240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ba97eb8e-ef6e-418f-874e-93333a30b814 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:53.005112 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ba97eb8e-ef6e-418f-874e-93333a30b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:53.015463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:53.016092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.016367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.016640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.017325 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:53.017628 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:53.019086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:53.034491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 90/176] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:53.035392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:53.071972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:53.132527 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 87/177] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:53.133917 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97eb8e-ef6e-418f-874e-93333a30b814 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:53.354682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3b95-f25d-4e31-9831-dfe0712e9156 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:53.378988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97eb8e-ef6e-418f-874e-93333a30b814 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:53.425340 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:53.449821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d039d-f8b2-4beb-a0b5-6d4df5b0fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:53.450885 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d039d-f8b2-4beb-a0b5-6d4df5b0fece None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.451363 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d039d-f8b2-4beb-a0b5-6d4df5b0fece None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.451834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d039d-f8b2-4beb-a0b5-6d4df5b0fece None admin] PATH_INFO: `/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.457690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d039d-f8b2-4beb-a0b5-6d4df5b0fece None admin] RBAC: Authorizing `identity:get_user(user_id=0d8f08b6a27347c1b6a0be2724b6aed0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:53.457690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d039d-f8b2-4beb-a0b5-6d4df5b0fece None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:53.460605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 88/178] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:53 2022] GET /identity/v3/users/0d8f08b6a27347c1b6a0be2724b6aed0 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:53.462875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb64b75-ea99-4876-869d-28faf7a833c4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.464003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb64b75-ea99-4876-869d-28faf7a833c4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.464645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb64b75-ea99-4876-869d-28faf7a833c4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.467580 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 89/179] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:53.475737 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb64b75-ea99-4876-869d-28faf7a833c4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:53.486593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218da45-1aa8-4ec9-b4f4-e1b4a8bd5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:53.487332 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218da45-1aa8-4ec9-b4f4-e1b4a8bd5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.487621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218da45-1aa8-4ec9-b4f4-e1b4a8bd5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.487996 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218da45-1aa8-4ec9-b4f4-e1b4a8bd5ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.488803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218da45-1aa8-4ec9-b4f4-e1b4a8bd5ef1 None admin] RBAC: Adding query filter params (role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=0d8f08b6a27347c1b6a0be2724b6aed0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:53.489115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218da45-1aa8-4ec9-b4f4-e1b4a8bd5ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:53.490741 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218da45-1aa8-4ec9-b4f4-e1b4a8bd5ef1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:53.502057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 91/180] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:53 2022] GET /identity/v3/role_assignments?user.id=0d8f08b6a27347c1b6a0be2724b6aed0&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 608 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:53.503373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5be33f-12d1-48ed-9fb2-394637956e4b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.503659 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5be33f-12d1-48ed-9fb2-394637956e4b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.503940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5be33f-12d1-48ed-9fb2-394637956e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.546795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4b5be33f-12d1-48ed-9fb2-394637956e4b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:53.548535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4b5be33f-12d1-48ed-9fb2-394637956e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:53.591512 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:53.690828 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb64b75-ea99-4876-869d-28faf7a833c4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:53.757283 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:53.758015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.758373 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.758715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.760680 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 92/181] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:53.762018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1145-ffe3-4554-877a-78afe8a84cc2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.762299 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1145-ffe3-4554-877a-78afe8a84cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.762574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1145-ffe3-4554-877a-78afe8a84cc2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.764388 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 93/182] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:53.765334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac899-dd42-48df-a41f-c8525eee3557 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.765604 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac899-dd42-48df-a41f-c8525eee3557 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.765987 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac899-dd42-48df-a41f-c8525eee3557 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.767189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 94/183] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:53.777263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324417ab-965c-456e-a276-2d247122df5e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.777685 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324417ab-965c-456e-a276-2d247122df5e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.777869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324417ab-965c-456e-a276-2d247122df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.799631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-324417ab-965c-456e-a276-2d247122df5e None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:53.800879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-324417ab-965c-456e-a276-2d247122df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:53.918052 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 95/184] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:53.919551 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63399bd-b82d-4acc-b81b-e7b8c78c7446 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:53.919839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63399bd-b82d-4acc-b81b-e7b8c78c7446 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:53.920123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63399bd-b82d-4acc-b81b-e7b8c78c7446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:53.925569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:53.930099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:53.941962 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a63399bd-b82d-4acc-b81b-e7b8c78c7446 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:53.943088 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a63399bd-b82d-4acc-b81b-e7b8c78c7446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:53.995473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:54.034448 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:54.041585 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 96/185] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:54.042304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63399bd-b82d-4acc-b81b-e7b8c78c7446 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:54.135896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 90/186] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:54.145122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:54.287998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63399bd-b82d-4acc-b81b-e7b8c78c7446 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:54.338728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a0812-8235-4a1e-92f0-4361c8a48063 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:54.375841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:54.376941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:54.377464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:54.377981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:54.400018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:54.404627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:54.406230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:54.407018 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:54.407715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] PATH_INFO: `/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:54.409203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:54.410883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:54.412436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 97/187] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:54.413691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:54.418866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] RBAC: Authorizing `identity:get_project(project_id=ee7ccf62c1624ecaae04fe78d935d45d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:54.418866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:54.418866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 91/188] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/projects/ee7ccf62c1624ecaae04fe78d935d45d => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:54.420327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:54.432762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:54.492731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:54.567801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d89fd-7e5a-4a81-8202-5aa1a52d28f7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:54.594386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64912e28-5a70-477b-808e-9937c7032530 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:54.612678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:54.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:54.614021 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:54.614412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:54.633367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:54.639277 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:54.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:54.641796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:31:54.647262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:54.648477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:54.648477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:54.648477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:54.648851 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 92/189] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:54.648986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:54.649108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:54.649220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:54.649220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 98/190] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:54.649431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:54.747539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:54.802051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882017e-27bb-4f34-9c37-a5e95c144b15 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:54.803872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:54.814511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c4abb-f911-46fb-a43b-bb66e6f0bc1c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:54.845323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:54.845917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:54.846187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:54.846453 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:54.847237 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=ee7ccf62c1624ecaae04fe78d935d45d, user.id=0d8f08b6a27347c1b6a0be2724b6aed0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:54.847548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:54.849097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:54.856806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 99/191] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/role_assignments?user.id=0d8f08b6a27347c1b6a0be2724b6aed0&scope.project.id=ee7ccf62c1624ecaae04fe78d935d45d&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:54.857729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:54.870153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:54.870814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:54.871093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:54.871370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:54.872085 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:54.872388 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:54.873884 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:54.884008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 93/192] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:54.884914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:55.031665 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2f7ab-e5b8-4711-9b2d-956396e6b34b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.036858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fea03-1841-4e23-b6d9-b33b45895398 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.083713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:55.092587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.093576 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.093933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.094550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:55.100774 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.101840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.102354 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.102927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:55.104234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:55.104939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:55.107733 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:55.109898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:55.115831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:55.117493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 100/193] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:55.120113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:55.131019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 94/194] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:55.132687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:55.167928 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:55.289795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0f1a9-daaa-4893-9cd0-932912c88edf None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.292101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d456fc-f90f-4bf7-b884-04de39630fe0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.326562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.327231 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.327581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.327860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] PATH_INFO: `/v3/users/40af6484019c4d6e8e016c7e092c9342` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:55.346023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] RBAC: Authorizing `identity:get_user(user_id=40af6484019c4d6e8e016c7e092c9342)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:55.348684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:55.349330 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.350328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.350832 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.351227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:55.356493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 95/195] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:55 2022] GET /identity/v3/users/40af6484019c4d6e8e016c7e092c9342 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:55.356714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:55.356838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:55.356924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:55.382576 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 101/196] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:31:55 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:31:55.383909 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:55.440572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:55.546022 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65b12f-ab72-451b-8a17-7b7a2d4355f4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.546743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:55.583825 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2936e-e50a-455d-9146-5ce02b031de8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.630516 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.631432 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.631870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.632687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:55.634143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:55.634408 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:55.637646 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:55.641890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.642846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.643350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.643820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] PATH_INFO: `/v3/users/6f5f6bc0c1014c3badf8b2d43e96bfaf` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:55.645308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] RBAC: Authorizing `identity:get_user(user_id=6f5f6bc0c1014c3badf8b2d43e96bfaf)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:55.646846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:55.648489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 102/197] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:55 2022] GET /identity/v3/users/6f5f6bc0c1014c3badf8b2d43e96bfaf => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:55.650657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:55.653748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 96/198] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:31:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:55.655570 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:55.849829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730fa9a-cef6-4f31-ab9f-7b8e939662b6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.872511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447e62-9e8e-433b-bd55-973bac9a30ec None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:55.890973 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.891549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.891826 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.892089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:55.901066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:55.918306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:55.945682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:55.946446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:55.946798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:55.947146 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:56.020995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:56.024244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:56.027486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:56.029095 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:56.141945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 97/199] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:56.143466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:56.168587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:56.189996 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 103/200] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:56.190872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:56.246974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:56.323330 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a2ea-6871-4320-9999-551e1e0f6a09 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:56.366607 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36e75-9675-4bc4-abe0-721593764d14 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:56.374134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:56.375488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:56.376325 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:56.376997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:56.379553 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:56.382660 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:56.387820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 104/201] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:56 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:56.389843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:56.422872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:56.424025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:56.424483 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:56.424954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] PATH_INFO: `/v3/users/40af6484019c4d6e8e016c7e092c9342` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:56.427180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] RBAC: Authorizing `identity:get_user(user_id=40af6484019c4d6e8e016c7e092c9342)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:56.429628 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:56.433267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 98/202] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:56 2022] GET /identity/v3/users/40af6484019c4d6e8e016c7e092c9342 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:56.434498 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:56.598034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:56.601406 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a684dc-ad23-4540-a117-ff645b328e89 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:56.645825 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:56.653860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679bac3-825e-47ac-b839-6445468ae288 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:56.678396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:56.679380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:56.679844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:56.680283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:56.683036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:56.685903 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:56.689563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 105/203] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:56 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:56.695082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:56.729810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:56.731338 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:56.732255 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:56.733001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:56.734800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] RBAC: Adding query filter params (role.id=80ad5d7540594fb487d2f2b65c7e7532, scope.project.id=33030c4724a540db9ef3256cf305f68c, user.id=6f5f6bc0c1014c3badf8b2d43e96bfaf) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:56.735643 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:56.738939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:56.752340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 99/204] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:56 2022] GET /identity/v3/role_assignments?user.id=6f5f6bc0c1014c3badf8b2d43e96bfaf&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=80ad5d7540594fb487d2f2b65c7e7532 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:56.754315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:56.998491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77270f3d-342c-4311-86c0-752bf8d1178d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:57.017486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdca7e-609c-4dc7-800b-d4f01aeca127 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:57.071296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:57.072518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:57.073565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:57.074181 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:57.075751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=40af6484019c4d6e8e016c7e092c9342) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:57.076652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:57.079797 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:57.091180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 100/205] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:56 2022] GET /identity/v3/role_assignments?user.id=40af6484019c4d6e8e016c7e092c9342&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:57.092594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:57.093943 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:57.094610 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:57.095222 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:57.231844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:57.263415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:57.266234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:57.473111 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 106/206] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:31:57.480931 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:57.498185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:57.666791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f311f2-2d94-4f32-ab44-32c56a4ed722 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:57.729816 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5299be-cafa-4586-a1f4-bd61389f5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:57.730985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5299be-cafa-4586-a1f4-bd61389f5e0f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:57.731549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5299be-cafa-4586-a1f4-bd61389f5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:57.732042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5299be-cafa-4586-a1f4-bd61389f5e0f None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:57.734149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5299be-cafa-4586-a1f4-bd61389f5e0f None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:57.736975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5299be-cafa-4586-a1f4-bd61389f5e0f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:57.740135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 101/207] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:31:57 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:57.751521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:57.911870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:57.940224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70d96-a3bc-4c93-8b79-71f0ca3819f1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:58.002717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb0a03-1a02-4182-bd38-d050dc6e3f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:58.003770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb0a03-1a02-4182-bd38-d050dc6e3f94 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:58.004253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb0a03-1a02-4182-bd38-d050dc6e3f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:58.004760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb0a03-1a02-4182-bd38-d050dc6e3f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:58.006080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb0a03-1a02-4182-bd38-d050dc6e3f94 None admin] RBAC: Adding query filter params (role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=40af6484019c4d6e8e016c7e092c9342) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:58.006627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb0a03-1a02-4182-bd38-d050dc6e3f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:58.009644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb0a03-1a02-4182-bd38-d050dc6e3f94 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:58.020990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 107/208] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:31:57 2022] GET /identity/v3/role_assignments?user.id=40af6484019c4d6e8e016c7e092c9342&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:58.582334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9ccc-8b7c-404f-9a84-1cb395453d9c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:58.582891 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9ccc-8b7c-404f-9a84-1cb395453d9c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:58.583583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9ccc-8b7c-404f-9a84-1cb395453d9c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:58.586394 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 102/209] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:58.595272 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdc7a-1f92-4744-adc4-40b79f14a8e6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:58.596066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdc7a-1f92-4744-adc4-40b79f14a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:58.596380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdc7a-1f92-4744-adc4-40b79f14a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:58.632633 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-701fdc7a-1f92-4744-adc4-40b79f14a8e6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:58.636223 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-701fdc7a-1f92-4744-adc4-40b79f14a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:58.747424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 108/210] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:31:59.022038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d9ccc-8b7c-404f-9a84-1cb395453d9c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:59.174435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:59.225117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d9ccc-8b7c-404f-9a84-1cb395453d9c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:59.238011 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640ce4-003c-486b-9ecf-c79097b2d2ee None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:59.238634 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640ce4-003c-486b-9ecf-c79097b2d2ee None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:59.239108 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640ce4-003c-486b-9ecf-c79097b2d2ee None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:59.240687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 109/211] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:31:59.246450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aad61-e23e-4b08-890a-6cb14c984d58 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:59.247078 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aad61-e23e-4b08-890a-6cb14c984d58 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:59.247550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aad61-e23e-4b08-890a-6cb14c984d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:59.270721 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-670aad61-e23e-4b08-890a-6cb14c984d58 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:31:59.272682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-670aad61-e23e-4b08-890a-6cb14c984d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:31:59.290762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96769b22-abef-479c-b389-2f155254a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:59.292022 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769b22-abef-479c-b389-2f155254a387 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:59.292299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769b22-abef-479c-b389-2f155254a387 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:59.292569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769b22-abef-479c-b389-2f155254a387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:59.305107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96769b22-abef-479c-b389-2f155254a387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-96769b22-abef-479c-b389-2f155254a387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:31:59.312362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:31:59.313422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:31:59.315933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:31:59.318060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 103/212] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:31:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:31:59.331581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96769b22-abef-479c-b389-2f155254a387 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:59.427705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 110/213] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:31:59.538705 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96769b22-abef-479c-b389-2f155254a387 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:59.606281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:59.607379 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:59.607873 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:59.608349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:59.609522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:31:59.610097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:59.612694 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:59.615245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:59.631985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 104/214] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:31:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:59.642131 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aad61-e23e-4b08-890a-6cb14c984d58 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:59.674203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:31:59.735200 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:59.835227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aad61-e23e-4b08-890a-6cb14c984d58 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:59.878964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fb66-5235-4781-a5fd-592abd2d3224 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:31:59.902183 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:59.903722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:59.904377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:59.905044 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] PATH_INFO: `/v3/users/572e1b7d3add478692e851e0fd8bb1b7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:59.922915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:31:59.923848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:31:59.924342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:31:59.924819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:31:59.926340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:59.928034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:59.929983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 105/215] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:31:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:31:59.934836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] RBAC: Authorizing `identity:get_user(user_id=572e1b7d3add478692e851e0fd8bb1b7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:31:59.934836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:31:59.936096 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:31:59.937256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 111/216] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:31:59 2022] GET /identity/v3/users/572e1b7d3add478692e851e0fd8bb1b7 => generated 297 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:31:59.945279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:00.011939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:00.040705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:00.059008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73023ce-395f-4d2c-9d9d-488e1f2442f4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:00.082160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6ab0f-83b2-49d8-9ad0-4078aa401103 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:00.100907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:00.102022 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:00.102506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:00.103007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:00.103938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:00.105621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:00.122330 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee035120-c332-4931-97f1-7ca8f3c06f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:00.123403 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035120-c332-4931-97f1-7ca8f3c06f2d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:00.123706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035120-c332-4931-97f1-7ca8f3c06f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:00.123999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035120-c332-4931-97f1-7ca8f3c06f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:00.133042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 106/217] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:31:59 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:00.210750 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee035120-c332-4931-97f1-7ca8f3c06f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:00.212281 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee035120-c332-4931-97f1-7ca8f3c06f2d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:00.296206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:00.344001 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 112/218] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:32:00.346845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:00.382473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666ac27-3a3d-453e-aa62-e46c54037daa None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:00.382668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666ac27-3a3d-453e-aa62-e46c54037daa None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:00.382932 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666ac27-3a3d-453e-aa62-e46c54037daa None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:00.384686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 113/219] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:32:00.390163 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136e30-6940-4318-8b8a-179101844582 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:00.390772 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136e30-6940-4318-8b8a-179101844582 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:00.390772 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136e30-6940-4318-8b8a-179101844582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:00.412791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-99136e30-6940-4318-8b8a-179101844582 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:00.414333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-99136e30-6940-4318-8b8a-179101844582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:00.474811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561554-d0fb-49fd-9d5c-716407189aeb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:00.504611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:00.510587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 114/220] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:00.525131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:00.525858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:00.526138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:00.526410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:00.529457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:00.531013 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:00.532939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 107/221] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:00 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:00.539351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99136e30-6940-4318-8b8a-179101844582 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:00.660984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:00.668440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99136e30-6940-4318-8b8a-179101844582 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:00.713840 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:00.714488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:00.714762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:00.715028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:00.715789 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=572e1b7d3add478692e851e0fd8bb1b7) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:00.716171 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:00.717763 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:00.724146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 115/222] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:00 2022] GET /identity/v3/role_assignments?user.id=572e1b7d3add478692e851e0fd8bb1b7&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:00.821782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:00.968294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad400-62df-4f56-81e8-75e7c376d3eb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:01.018082 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4b3b-e7e8-477b-b641-692350a95298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:01.018803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4b3b-e7e8-477b-b641-692350a95298 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:01.019092 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4b3b-e7e8-477b-b641-692350a95298 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:01.019364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4b3b-e7e8-477b-b641-692350a95298 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:01.034570 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4b3b-e7e8-477b-b641-692350a95298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-fafc4b3b-e7e8-477b-b641-692350a95298 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:01.040441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:01.042014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:01.042827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 108/223] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:32:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:01.050966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:01.055754 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a7ff6-36d1-4f3e-be66-3a0a3cbea7e0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:01.056080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a7ff6-36d1-4f3e-be66-3a0a3cbea7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:01.056326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a7ff6-36d1-4f3e-be66-3a0a3cbea7e0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:01.057883 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 109/224] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:01.063943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3cbf-c559-4115-b25d-61b7fdf5afa3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:01.064470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3cbf-c559-4115-b25d-61b7fdf5afa3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:01.064958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3cbf-c559-4115-b25d-61b7fdf5afa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:01.094565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-30cb3cbf-c559-4115-b25d-61b7fdf5afa3 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:01.095845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-30cb3cbf-c559-4115-b25d-61b7fdf5afa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:01.158027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:01.186846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 110/225] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:01.231138 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab432cc-5d0c-4075-8aa6-55ea71715996 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:01.277433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:01.278119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:01.278404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:01.278682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:01.279401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:01.279709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:01.281146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:01.291789 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 116/226] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:01.297692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb3cbf-c559-4115-b25d-61b7fdf5afa3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:01.474930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb3cbf-c559-4115-b25d-61b7fdf5afa3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:01.534669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:01.535252 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:01.535528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:01.535796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] PATH_INFO: `/v3/users/40af6484019c4d6e8e016c7e092c9342` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:01.538410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] RBAC: Authorizing `identity:get_user(user_id=40af6484019c4d6e8e016c7e092c9342)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:01.540155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:01.542803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 111/227] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:01 2022] GET /identity/v3/users/40af6484019c4d6e8e016c7e092c9342 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:01.548444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:01.550871 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:01.601891 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:01.616072 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:01.672651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b042-1abd-47df-9736-b33ad7f6be6a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:01.711398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:01.712566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:01.712998 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:01.713896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:01.727345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:01.737983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:01.738943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:01.739716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 112/228] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:01.747246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:01.851799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bfae-410f-4d5d-ba20-561abce62190 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:01.873375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb805a-9fb7-4821-9454-d9914b4bfd6e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:01.902257 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:01.915578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:01.917265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:01.917785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:01.918265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:01.919151 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:01.919676 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:01.922034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:01.931746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 113/229] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:01.937715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:02.006513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:02.007128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:02.007413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:02.007691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:02.014541 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:02.016038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:02.018007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 117/230] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:01 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:02.030725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:02.065019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a093238-a011-4a00-bbb7-547f10138ea1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:02.107493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:02.108880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:02.109405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:02.109953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] PATH_INFO: `/v3/users/40af6484019c4d6e8e016c7e092c9342` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:02.111456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] RBAC: Authorizing `identity:get_user(user_id=40af6484019c4d6e8e016c7e092c9342)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:02.113159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:02.115974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 114/231] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:01 2022] GET /identity/v3/users/40af6484019c4d6e8e016c7e092c9342 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:02.122077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:02.174702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:02.263958 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:02.288065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450544b0-d2ed-4756-a710-ee110bf99bca None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:02.306175 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e4d8-0504-4db5-8891-a1d3bf0ace57 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:02.365153 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbcde4-f944-4f4e-b5a5-8fb39f865ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:02.366227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbcde4-f944-4f4e-b5a5-8fb39f865ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:02.368305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbcde4-f944-4f4e-b5a5-8fb39f865ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:02.368812 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbcde4-f944-4f4e-b5a5-8fb39f865ee5 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/40af6484019c4d6e8e016c7e092c9342/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:02.375280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbcde4-f944-4f4e-b5a5-8fb39f865ee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f29f91d86c343dca7b2eab39e67a922, user_id=40af6484019c4d6e8e016c7e092c9342, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:02.377721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:02.378106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbcde4-f944-4f4e-b5a5-8fb39f865ee5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:02.378824 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:02.379304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:02.379774 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:02.381175 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:02.383162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:02.390035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 115/232] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:02 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:02.392169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:02.413009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 118/233] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:32:02 2022] PUT /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/40af6484019c4d6e8e016c7e092c9342/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:02.531683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ebc7-4a51-48aa-9178-c7cb6d5ccc2f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:02.542193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:02.583169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30971-4b12-4303-ad65-7d6fb2d00a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:02.583929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30971-4b12-4303-ad65-7d6fb2d00a0e None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:02.584213 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30971-4b12-4303-ad65-7d6fb2d00a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:02.584483 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30971-4b12-4303-ad65-7d6fb2d00a0e None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/40af6484019c4d6e8e016c7e092c9342/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:02.586914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30971-4b12-4303-ad65-7d6fb2d00a0e None admin] RBAC: Authorizing `identity:create_grant(project_id=6f29f91d86c343dca7b2eab39e67a922, user_id=40af6484019c4d6e8e016c7e092c9342, role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:02.589009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30971-4b12-4303-ad65-7d6fb2d00a0e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:02.613955 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 116/234] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:32:02 2022] PUT /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/40af6484019c4d6e8e016c7e092c9342/roles/80756a2a2a9a47918e65c4ed873146eb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:03.375803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ab1c-1b25-4277-bee3-50703620e4f4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:03.376784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ab1c-1b25-4277-bee3-50703620e4f4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:03.377266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ab1c-1b25-4277-bee3-50703620e4f4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:03.379188 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 119/235] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:03.385549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de387f-b145-4f3a-ad0f-cdea6257d592 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:03.386188 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de387f-b145-4f3a-ad0f-cdea6257d592 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:03.386188 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de387f-b145-4f3a-ad0f-cdea6257d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:03.413877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-04de387f-b145-4f3a-ad0f-cdea6257d592 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:03.417244 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-04de387f-b145-4f3a-ad0f-cdea6257d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:03.530858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 117/236] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:03.744805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146ed12-9d3a-4720-9065-1fad60e1e3ee None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:03.745067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146ed12-9d3a-4720-9065-1fad60e1e3ee None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:03.745390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146ed12-9d3a-4720-9065-1fad60e1e3ee None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:03.747094 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 120/237] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:03.754810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ada3c-5e57-4a21-b86c-d3375de38bed None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:03.755075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ada3c-5e57-4a21-b86c-d3375de38bed None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:03.755356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ada3c-5e57-4a21-b86c-d3375de38bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:03.782827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7b0ada3c-5e57-4a21-b86c-d3375de38bed None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:03.784058 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7b0ada3c-5e57-4a21-b86c-d3375de38bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:03.883379 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 118/238] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:03.914662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146ed12-9d3a-4720-9065-1fad60e1e3ee None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:04.059192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ac75-1a75-4c0e-b788-a0eff98c0e98 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.059419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ac75-1a75-4c0e-b788-a0eff98c0e98 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.059703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ac75-1a75-4c0e-b788-a0eff98c0e98 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.060974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 119/239] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:04.068557 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f597-babd-402b-9e14-f47c8d641b9d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.068820 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f597-babd-402b-9e14-f47c8d641b9d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.069129 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f597-babd-402b-9e14-f47c8d641b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.070083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146ed12-9d3a-4720-9065-1fad60e1e3ee None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:04.098126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7bb7f597-babd-402b-9e14-f47c8d641b9d None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:04.099324 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7bb7f597-babd-402b-9e14-f47c8d641b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:04.126935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:04.159079 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:04.159731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.160011 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.160282 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.162344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:04.163824 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:04.165737 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 121/240] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:04.172926 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:04.203713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 120/241] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:04.222017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:04.304242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ea6c5-31a7-481c-bb84-6da20b2232b7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:04.323755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f597-babd-402b-9e14-f47c8d641b9d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:04.377608 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:04.378469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.378637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.378786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.379436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:04.380904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:04.423717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 122/242] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:32:04 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:04.502234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f597-babd-402b-9e14-f47c8d641b9d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:04.560476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:04.584733 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:04.585293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.585575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.585892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.622512 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:04.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:04.639951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:04.641555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 121/243] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:04.654149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:04.686223 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:04.688643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:04.735768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88ce71-1a47-48a2-bbbe-dbcdd1b5475d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:04.776375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:04.777787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.777787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.777787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.790364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:04.796097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:04.798515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:04.799681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 123/244] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:04.804236 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:04.852655 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf708-3625-48d4-86dc-98d74cf0eab6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:04.904234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:04.905490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.906016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.906492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.907566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:04.908086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:04.909803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:04.921608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 122/245] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:04.927247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:04.948360 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca0368-0756-4a25-99c8-5f4ec3b4e222 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:04.994402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:04.995020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:04.995305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:04.995586 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:04.996280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:04.996589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:04.998169 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:05.003694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:05.011921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 124/246] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:05.019734 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:05.043099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:05.083060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4a69-83e2-42b4-acd1-9541283ac7a8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:05.134807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:05.136036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:05.136422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:05.136797 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] PATH_INFO: `/v3/users/572e1b7d3add478692e851e0fd8bb1b7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:05.138513 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=572e1b7d3add478692e851e0fd8bb1b7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:05.140669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:05.142758 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 123/247] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:04 2022] GET /identity/v3/users/572e1b7d3add478692e851e0fd8bb1b7 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:05.149540 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:05.167595 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a273-c2b3-44d2-9bc5-c23880cbe6ee None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:05.224386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:05.225491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:05.226036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:05.226524 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] PATH_INFO: `/v3/users/bd85e92c0c5f4f1da0eb394ed79088a3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:05.246869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] RBAC: Authorizing `identity:get_user(user_id=bd85e92c0c5f4f1da0eb394ed79088a3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:05.248983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:05.251247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 125/248] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:05 2022] GET /identity/v3/users/bd85e92c0c5f4f1da0eb394ed79088a3 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:05.257573 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:05.292198 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0efc-3a38-4552-90d2-287566777cb5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:05.336866 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:05.341200 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:05.341795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:05.342075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:05.342348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:05.344479 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:05.346746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:05.348441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 124/249] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:05 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:05.354674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:05.375599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:05.427673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e466d-8f9c-4366-aa4f-2e45683af9e9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:05.497937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87519-4304-47ca-898d-01c6a72d6d41 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:05.504471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a124c-10e9-4e21-a9d9-b1e32ffb92e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:05.505956 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a124c-10e9-4e21-a9d9-b1e32ffb92e1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:05.506661 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a124c-10e9-4e21-a9d9-b1e32ffb92e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:05.507350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a124c-10e9-4e21-a9d9-b1e32ffb92e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:05.553595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3bdb0-b232-4224-9034-4d80332d90bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:05.555225 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3bdb0-b232-4224-9034-4d80332d90bd None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:05.556731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3bdb0-b232-4224-9034-4d80332d90bd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:05.557374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3bdb0-b232-4224-9034-4d80332d90bd None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/572e1b7d3add478692e851e0fd8bb1b7/roles/c5260227d3ff4cbf956c47e3590a0ba1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:05.563225 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3bdb0-b232-4224-9034-4d80332d90bd None admin] RBAC: Authorizing `identity:create_grant(project_id=6f29f91d86c343dca7b2eab39e67a922, user_id=572e1b7d3add478692e851e0fd8bb1b7, role_id=c5260227d3ff4cbf956c47e3590a0ba1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:05.567653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3bdb0-b232-4224-9034-4d80332d90bd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:05.615190 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 125/250] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:32:05 2022] PUT /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/572e1b7d3add478692e851e0fd8bb1b7/roles/c5260227d3ff4cbf956c47e3590a0ba1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:32:05.671260 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a124c-10e9-4e21-a9d9-b1e32ffb92e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:05.673235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a124c-10e9-4e21-a9d9-b1e32ffb92e1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:05.756594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:05.833684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7016cc9-2414-49d1-839e-5b820a1da577 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:05.834374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7016cc9-2414-49d1-839e-5b820a1da577 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:05.835024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7016cc9-2414-49d1-839e-5b820a1da577 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:05.835134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 126/251] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:32:05.837685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 126/252] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:05.843441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500f89-fbe6-412d-923d-59436820ae56 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:05.843809 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500f89-fbe6-412d-923d-59436820ae56 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:05.844150 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500f89-fbe6-412d-923d-59436820ae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:05.849525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7016cc9-2414-49d1-839e-5b820a1da577 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:05.881981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-79500f89-fbe6-412d-923d-59436820ae56 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:05.885487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-79500f89-fbe6-412d-923d-59436820ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:06.057342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:06.066127 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 127/253] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:06.123459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7016cc9-2414-49d1-839e-5b820a1da577 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:06.139728 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4942d4-fed7-4a06-b291-c26f0ac6b074 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:06.140909 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4942d4-fed7-4a06-b291-c26f0ac6b074 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:06.141492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4942d4-fed7-4a06-b291-c26f0ac6b074 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:06.149319 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 128/254] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:06.152082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf760-2be1-4103-84f3-e6c7b92fd48f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:06.153411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf760-2be1-4103-84f3-e6c7b92fd48f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:06.154031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf760-2be1-4103-84f3-e6c7b92fd48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:06.188909 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-166cf760-2be1-4103-84f3-e6c7b92fd48f None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:06.191214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-166cf760-2be1-4103-84f3-e6c7b92fd48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:06.195761 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:06.196633 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:06.197055 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:06.197523 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:06.198950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:06.200545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:06.202544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 127/255] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:05 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:06.211770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:06.360263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 129/256] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:06.408305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ddda3-7c46-4813-8cc2-7f15d336da91 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:06.463689 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:06.464575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:06.464998 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:06.465420 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:06.466524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] RBAC: Adding query filter params (role.id=80ad5d7540594fb487d2f2b65c7e7532, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=bd85e92c0c5f4f1da0eb394ed79088a3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:06.467053 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:06.468765 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:06.479621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 128/257] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:06 2022] GET /identity/v3/role_assignments?user.id=bd85e92c0c5f4f1da0eb394ed79088a3&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=80ad5d7540594fb487d2f2b65c7e7532 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:06.702002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf760-2be1-4103-84f3-e6c7b92fd48f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:06.723842 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:06.820556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:06.837706 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:06.854147 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf760-2be1-4103-84f3-e6c7b92fd48f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:06.928811 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:06.929851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:06.930326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:06.930793 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:06.959078 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:06.968095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:06.969065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:06.969898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:06.974222 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 130/258] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:06.983719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:07.120188 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c305-66bd-4c22-ab21-d052ba3eab10 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:07.206338 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:07.219838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:07.220907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:07.221382 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:07.221895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:07.246981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5d5e-d143-4266-a1d9-2fccf9d0eb32 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:07.257214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:07.278023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:07.279760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:07.281392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:07.287306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 129/259] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:07.296389 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:07.310542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:07.311188 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:07.311465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:07.311743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:07.312444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:07.312746 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:07.314237 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:07.323753 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 131/260] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:07.358771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:07.528548 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:07.560003 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef04e9d-e887-4e93-abf6-537e1077bed5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:07.629929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:07.629929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:07.629929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:07.629929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] PATH_INFO: `/v3/users/40af6484019c4d6e8e016c7e092c9342` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:07.635167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] RBAC: Authorizing `identity:get_user(user_id=40af6484019c4d6e8e016c7e092c9342)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:07.636682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:07.638455 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 132/261] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:07 2022] GET /identity/v3/users/40af6484019c4d6e8e016c7e092c9342 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:07.646959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:07.656606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55826c5-49df-469e-b9ca-6127a75e2f5e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:07.674582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:07.731066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:07.731710 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:07.732001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:07.732282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:07.734680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:07.734680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:07.734680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:07.753327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 130/262] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:07.762423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:07.847782 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513be1-397d-45eb-ac91-4cec91f11cdc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:07.950925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:07.952176 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:07.952776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:07.953378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:07.983983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3735e1-a614-468d-9cb0-4669c46dbe9d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:08.036582 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:08.062952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:08.063607 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:08.063887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:08.064172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] PATH_INFO: `/v3/users/40af6484019c4d6e8e016c7e092c9342` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:08.065822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] RBAC: Authorizing `identity:get_user(user_id=40af6484019c4d6e8e016c7e092c9342)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:08.067437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:08.069204 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 131/263] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:07 2022] GET /identity/v3/users/40af6484019c4d6e8e016c7e092c9342 => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:08.091906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:08.167924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:08.170775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:08.187748 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:08.370453 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e165e-9c71-4f76-813a-36346c2e78fa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:08.374290 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 133/264] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:32:08.383101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:08.476588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:08.477228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:08.477512 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:08.477817 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:08.644088 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:08.654566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:08.656258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:08.729394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfce4d-1923-442d-8552-6a39eb28ff06 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:08.746266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:08.774753 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 132/265] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:32:08.778870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:08.847380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ed95-e941-4715-8753-8aeb9ac07715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:08.848044 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ed95-e941-4715-8753-8aeb9ac07715 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:08.848582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ed95-e941-4715-8753-8aeb9ac07715 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:08.848582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ed95-e941-4715-8753-8aeb9ac07715 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:08.849801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ed95-e941-4715-8753-8aeb9ac07715 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:08.851437 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ed95-e941-4715-8753-8aeb9ac07715 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:08.853373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 134/266] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:08 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:08.861074 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8460-8f5a-4e5a-9dd3-cd556d320f17 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:08.861370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8460-8f5a-4e5a-9dd3-cd556d320f17 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:08.861630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8460-8f5a-4e5a-9dd3-cd556d320f17 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:08.863254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 135/267] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:08.864128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8460-8f5a-4e5a-9dd3-cd556d320f17 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:08.893680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:08.910468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6bb24-c04a-4ef9-80df-a7598cc5622e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:09.001358 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b61c6-7bc5-4374-955d-708c781353b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:09.002444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b61c6-7bc5-4374-955d-708c781353b4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.002954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b61c6-7bc5-4374-955d-708c781353b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.003436 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b61c6-7bc5-4374-955d-708c781353b4 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.008734 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b61c6-7bc5-4374-955d-708c781353b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:09.013517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b61c6-7bc5-4374-955d-708c781353b4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:09.017104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 133/268] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:08 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:09.019254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b898-e346-47b3-95dc-ad1f708c3477 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.019756 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b898-e346-47b3-95dc-ad1f708c3477 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.021710 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b898-e346-47b3-95dc-ad1f708c3477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.074771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4e32b898-e346-47b3-95dc-ad1f708c3477 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:09.076341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4e32b898-e346-47b3-95dc-ad1f708c3477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:09.112695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8460-8f5a-4e5a-9dd3-cd556d320f17 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:09.187318 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:09.188661 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.189356 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.189851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.193676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] RBAC: Adding query filter params (role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=40af6484019c4d6e8e016c7e092c9342) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:09.193676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:09.194752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:09.208269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 136/269] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:08 2022] GET /identity/v3/role_assignments?user.id=40af6484019c4d6e8e016c7e092c9342&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:09.209841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:09.240632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 134/270] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:09.284893 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:09.304689 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0590-ea3d-45ad-bd4b-7472ad14ba76 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.305327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0590-ea3d-45ad-bd4b-7472ad14ba76 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.305905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0590-ea3d-45ad-bd4b-7472ad14ba76 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.308222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 135/271] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:32:09.314127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0540255-71a4-450b-a2cb-e5440ec879f5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.314775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0540255-71a4-450b-a2cb-e5440ec879f5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.315292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0540255-71a4-450b-a2cb-e5440ec879f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.343434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c0540255-71a4-450b-a2cb-e5440ec879f5 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:09.348089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c0540255-71a4-450b-a2cb-e5440ec879f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:09.389162 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465c45-dc91-413d-b3e5-016c04d486bb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:09.441038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:09.442247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.442729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.443187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.444111 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=40af6484019c4d6e8e016c7e092c9342) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:09.444611 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:09.446438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:09.456987 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 137/272] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:09 2022] GET /identity/v3/role_assignments?user.id=40af6484019c4d6e8e016c7e092c9342&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:09.507064 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 136/273] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:09.778699 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:09.803728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0540255-71a4-450b-a2cb-e5440ec879f5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:09.848903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:09.924035 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd0e57-a760-45d8-94d2-f917355f5876 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:09.926936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:09.958277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0540255-71a4-450b-a2cb-e5440ec879f5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:09.976237 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0e90-e8be-4005-b8ed-9cab0d1f0318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:09.976900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0e90-e8be-4005-b8ed-9cab0d1f0318 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.977180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0e90-e8be-4005-b8ed-9cab0d1f0318 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.977457 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0e90-e8be-4005-b8ed-9cab0d1f0318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.979312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b0e90-e8be-4005-b8ed-9cab0d1f0318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:09.980860 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b0e90-e8be-4005-b8ed-9cab0d1f0318 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:09.982760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 138/274] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:09.984031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48df0-056c-45f4-8397-3f87cb8c4371 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:09.984316 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48df0-056c-45f4-8397-3f87cb8c4371 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:09.984649 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48df0-056c-45f4-8397-3f87cb8c4371 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:09.990567 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 139/275] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:09.991540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48df0-056c-45f4-8397-3f87cb8c4371 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:10.009807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8cd6f-77ab-4b88-b50d-9727b81e7055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:10.010623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cd6f-77ab-4b88-b50d-9727b81e7055 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.010974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cd6f-77ab-4b88-b50d-9727b81e7055 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.011623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cd6f-77ab-4b88-b50d-9727b81e7055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.023536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8cd6f-77ab-4b88-b50d-9727b81e7055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4bd8cd6f-77ab-4b88-b50d-9727b81e7055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:10.028482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:10.029393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:10.030317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 137/276] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:10.030968 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740db9-f4d4-4dfa-a564-fbad7922e709 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.036869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740db9-f4d4-4dfa-a564-fbad7922e709 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.036869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740db9-f4d4-4dfa-a564-fbad7922e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.053962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-da740db9-f4d4-4dfa-a564-fbad7922e709 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:10.055797 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-da740db9-f4d4-4dfa-a564-fbad7922e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:10.137458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48df0-056c-45f4-8397-3f87cb8c4371 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:10.161687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 138/277] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:10.161687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740db9-f4d4-4dfa-a564-fbad7922e709 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:10.185891 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:10.197196 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:10.198118 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.198469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.198916 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.199968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:10.203353 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:10.250179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 140/278] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:32:09 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:10.352446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740db9-f4d4-4dfa-a564-fbad7922e709 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:10.423003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:10.424153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.424648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.425142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.426661 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:10.427284 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:10.430128 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:10.448674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:10.448845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 139/279] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:10.458697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:10.487870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:10.600244 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:10.614511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6808-6939-4de2-9d30-8c67654abe4a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:10.646452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375f40b-6bec-4a28-b82f-ab20f6f42e28 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:10.668620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7e7f-09ea-4219-996d-ebc6a8c66a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:10.669287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7e7f-09ea-4219-996d-ebc6a8c66a6f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.669573 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7e7f-09ea-4219-996d-ebc6a8c66a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.670422 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7e7f-09ea-4219-996d-ebc6a8c66a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.695488 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48896-2e05-44f4-b03e-6f4082a61a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:10.696148 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48896-2e05-44f4-b03e-6f4082a61a69 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.696425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48896-2e05-44f4-b03e-6f4082a61a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.696693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48896-2e05-44f4-b03e-6f4082a61a69 None admin] PATH_INFO: `/v3/users/089f9f34b5904f0daadc237cd6c1155d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.698439 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7e7f-09ea-4219-996d-ebc6a8c66a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-dd1d7e7f-09ea-4219-996d-ebc6a8c66a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:10.705756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:10.706823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:10.707771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:10.710647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 141/280] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:10.712595 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5b76-bb47-4b38-a671-4229a9bd5ad0 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.713062 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5b76-bb47-4b38-a671-4229a9bd5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.713484 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5b76-bb47-4b38-a671-4229a9bd5ad0 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.715970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 142/281] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:10.717617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb5b76-bb47-4b38-a671-4229a9bd5ad0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:10.722520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48896-2e05-44f4-b03e-6f4082a61a69 None admin] RBAC: Authorizing `identity:get_user(user_id=089f9f34b5904f0daadc237cd6c1155d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:10.723434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48896-2e05-44f4-b03e-6f4082a61a69 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:10.725595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 140/282] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:10 2022] GET /identity/v3/users/089f9f34b5904f0daadc237cd6c1155d => generated 293 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:10.727002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd697-fa4f-46bc-8f63-1e126e673073 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.727288 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd697-fa4f-46bc-8f63-1e126e673073 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.727563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd697-fa4f-46bc-8f63-1e126e673073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:10.749131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-788cd697-fa4f-46bc-8f63-1e126e673073 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:10.750380 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-788cd697-fa4f-46bc-8f63-1e126e673073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:10.850976 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:10.852119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 141/283] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:10.854232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd697-fa4f-46bc-8f63-1e126e673073 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:10.897859 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb5b76-bb47-4b38-a671-4229a9bd5ad0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:10.992631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:10.993703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:10.994664 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:10.995222 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:11.002703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:11.003455 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:11.004223 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:11.007371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:11.038861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 143/284] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:11.042538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd697-fa4f-46bc-8f63-1e126e673073 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:11.046798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:11.084858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:11.085491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:11.085805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:11.086076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:11.086818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, user.id=089f9f34b5904f0daadc237cd6c1155d, scope.system=all) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:11.087123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:11.089116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:11.100776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 142/285] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 22 02:32:10 2022] GET /identity/v3/role_assignments?user.id=089f9f34b5904f0daadc237cd6c1155d&scope.system=all&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:11.234602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f47995-4633-4ded-9cc2-ba3f0d18202c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:11.328172 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:11.329173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:11.329645 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:11.330159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] PATH_INFO: `/v3/users/572e1b7d3add478692e851e0fd8bb1b7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:11.333730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] RBAC: Authorizing `identity:get_user(user_id=572e1b7d3add478692e851e0fd8bb1b7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:11.336386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:11.339959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 144/286] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:11 2022] GET /identity/v3/users/572e1b7d3add478692e851e0fd8bb1b7 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:11.345607 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:11.368205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:11.413227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:11.529267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c4b68-eea7-4b47-8ee2-7c9f03ffc56e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:11.586771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:11.602541 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108def85-5ec7-43d1-85d5-b01780a6af98 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:11.607159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:11.607967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:11.608250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:11.608519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:11.686087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:11.686743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:11.687018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:11.687286 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:11.715329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:11.720726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:11.721688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:11.722594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 145/287] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:11.728168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:11.775967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:11.777472 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:11.898009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:11.953097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94e86-da28-4912-8f10-b38a6b905dd2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:12.002822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 143/288] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:12.007828 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:12.033401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:12.034122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:12.034353 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:12.034626 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:12.035320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:12.035619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:12.037044 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:12.062845 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 146/289] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:12.067258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:12.078205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:12.219374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db479a1-9845-4ca5-80a6-81fac739fb25 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:12.287520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:12.288567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:12.289047 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:12.289841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:12.292358 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:12.295202 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:12.298882 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 144/290] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:12 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:12.304123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3deb2-aa5e-4558-b996-9e03faeed912 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:12.308632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:12.416829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:12.418279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:12.418761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:12.419197 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] PATH_INFO: `/v3/users/bd85e92c0c5f4f1da0eb394ed79088a3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:12.421302 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] RBAC: Authorizing `identity:get_user(user_id=bd85e92c0c5f4f1da0eb394ed79088a3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:12.425135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:12.428799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 147/291] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:12 2022] GET /identity/v3/users/bd85e92c0c5f4f1da0eb394ed79088a3 => generated 297 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:12.435380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:12.454056 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:12.665596 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:12.670893 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566972f8-8b2a-46c1-86ea-972721d2e2ce None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:12.679268 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767be23-4998-4510-a0c8-538aa9a61bb0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:12.754591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:12.755242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:12.755521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:12.755795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:12.757278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:12.758795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:12.761057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 148/292] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:12 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:12.770451 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:12.772451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49adb01-7b2a-42fb-b360-9811b4c20b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:12.773101 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49adb01-7b2a-42fb-b360-9811b4c20b66 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:12.773383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49adb01-7b2a-42fb-b360-9811b4c20b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:12.773676 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49adb01-7b2a-42fb-b360-9811b4c20b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:12.777434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49adb01-7b2a-42fb-b360-9811b4c20b66 None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=572e1b7d3add478692e851e0fd8bb1b7) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:12.777779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49adb01-7b2a-42fb-b360-9811b4c20b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:12.779292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49adb01-7b2a-42fb-b360-9811b4c20b66 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:12.797467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 145/293] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:12 2022] GET /identity/v3/role_assignments?user.id=572e1b7d3add478692e851e0fd8bb1b7&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 608 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:12.890226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:12.924466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e59d8-73c0-4614-a1f3-ce6e615a8376 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:12.987114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28e73a-8ec1-42b2-9a1e-251ce9cbe3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:12.988148 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e73a-8ec1-42b2-9a1e-251ce9cbe3d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:12.988575 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e73a-8ec1-42b2-9a1e-251ce9cbe3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:12.989003 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e73a-8ec1-42b2-9a1e-251ce9cbe3d9 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/bd85e92c0c5f4f1da0eb394ed79088a3/roles/80ad5d7540594fb487d2f2b65c7e7532` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:12.996607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28e73a-8ec1-42b2-9a1e-251ce9cbe3d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f29f91d86c343dca7b2eab39e67a922, user_id=bd85e92c0c5f4f1da0eb394ed79088a3, role_id=80ad5d7540594fb487d2f2b65c7e7532)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:12.999231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28e73a-8ec1-42b2-9a1e-251ce9cbe3d9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:13.029631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 149/294] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:32:12 2022] PUT /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922/users/bd85e92c0c5f4f1da0eb394ed79088a3/roles/80ad5d7540594fb487d2f2b65c7e7532 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:13.663429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509738-b77b-409b-b3a5-d43ea83d0038 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:13.665141 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509738-b77b-409b-b3a5-d43ea83d0038 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:13.666443 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509738-b77b-409b-b3a5-d43ea83d0038 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:13.669164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 146/295] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:13.678298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8324-11a2-4a46-864a-a6501eef4da5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:13.679698 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8324-11a2-4a46-864a-a6501eef4da5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:13.680445 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8324-11a2-4a46-864a-a6501eef4da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:13.712376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1dbd8324-11a2-4a46-864a-a6501eef4da5 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:13.715128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1dbd8324-11a2-4a46-864a-a6501eef4da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:13.842252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 150/296] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:13.953203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8df27-d8e6-40b8-969c-d9e202f4e06c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:13.953713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8df27-d8e6-40b8-969c-d9e202f4e06c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:13.954499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8df27-d8e6-40b8-969c-d9e202f4e06c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:13.957475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 147/297] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:13.964800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45610ce4-ab3f-4f04-8158-8b7c744b72de None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:13.965685 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45610ce4-ab3f-4f04-8158-8b7c744b72de None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:13.966368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45610ce4-ab3f-4f04-8158-8b7c744b72de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:14.003119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385eb65-21ea-4455-b964-7e779c715a9d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:14.003312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-45610ce4-ab3f-4f04-8158-8b7c744b72de None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:14.003784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385eb65-21ea-4455-b964-7e779c715a9d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:14.004257 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385eb65-21ea-4455-b964-7e779c715a9d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:14.005851 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 148/298] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:32:14.008196 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-45610ce4-ab3f-4f04-8158-8b7c744b72de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:14.013412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad973f-85ae-403d-8631-1a8fa902174b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:14.014981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad973f-85ae-403d-8631-1a8fa902174b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:14.015486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad973f-85ae-403d-8631-1a8fa902174b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:14.052461 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b4ad973f-85ae-403d-8631-1a8fa902174b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:14.054838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b4ad973f-85ae-403d-8631-1a8fa902174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:14.085384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:14.097168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 151/299] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:14.183884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45610ce4-ab3f-4f04-8158-8b7c744b72de None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:14.211527 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 149/300] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:14.393444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45610ce4-ab3f-4f04-8158-8b7c744b72de None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:14.399556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad973f-85ae-403d-8631-1a8fa902174b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:14.475548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:14.481427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:14.486109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:14.486899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:14.490018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:14.494700 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:14.501202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 152/301] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:14.507250 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:14.576849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:14.595831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad973f-85ae-403d-8631-1a8fa902174b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:14.613452 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:14.647477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:14.648142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:14.648425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:14.648703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:14.662972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:14.669115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:14.671415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:14.672838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:14.675660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 150/302] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:14.676676 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:14.713920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bface-1270-4722-a9f8-e3dd770031a0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:14.769908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:14.771331 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:14.771537 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:14.771990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] PATH_INFO: `/v3/groups` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:14.773037 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:14.776017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:14.808257 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 153/303] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Sep 22 02:32:14 2022] POST /identity/v3/groups => generated 229 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:14.811501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:14.838460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5e69-9b7b-4b8d-be02-7f1fcd74b768 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:14.901969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:14.903823 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:14.904215 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:14.904600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:14.938835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:14.951518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:14.953250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:14.955867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:14.957118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 151/304] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:14.959652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:14.985699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:15.131004 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aa208-64dd-41cd-8eb8-8b1652fc0170 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:15.190035 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:15.202062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e897be-9f3b-41b7-969a-7f4800f63134 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:15.227262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:15.228784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:15.229554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:15.230381 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:15.232140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:15.233448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:15.236603 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:15.261521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 154/305] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:15.273530 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:15.292682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:15.295724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:15.297929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:15.298220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:15.299006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:15.299324 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:15.300717 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:15.332102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 152/306] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:15.338251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:15.432186 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:15.474568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061fe1-f27e-4757-b7ce-6345830d68cc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:15.530328 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:15.530985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:15.531264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:15.531540 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] PATH_INFO: `/v3/users/089f9f34b5904f0daadc237cd6c1155d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:15.535468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] RBAC: Authorizing `identity:get_user(user_id=089f9f34b5904f0daadc237cd6c1155d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:15.536936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:15.544496 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 153/307] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:15 2022] GET /identity/v3/users/089f9f34b5904f0daadc237cd6c1155d => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:15.545992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:15.566537 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9907-ec97-4f05-9c10-3658e8bd9d22 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:15.669204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:15.669963 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:15.670255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:15.670525 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] PATH_INFO: `/v3/users/1519569d93ac4dcf9b62aea67dbd9271` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:15.704472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] RBAC: Authorizing `identity:get_user(user_id=1519569d93ac4dcf9b62aea67dbd9271)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:15.705924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:15.712243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 155/308] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:15 2022] GET /identity/v3/users/1519569d93ac4dcf9b62aea67dbd9271 => generated 293 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:15.713795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:15.815339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a02c0d-63c1-47a0-909e-a15082023f7f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:15.828073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:15.905160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62038b7-0937-41fc-b412-185d813da326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:15.905890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62038b7-0937-41fc-b412-185d813da326 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:15.906170 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62038b7-0937-41fc-b412-185d813da326 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:15.906431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62038b7-0937-41fc-b412-185d813da326 None admin] PATH_INFO: `/v3/system/users/089f9f34b5904f0daadc237cd6c1155d/roles/c5260227d3ff4cbf956c47e3590a0ba1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:15.907915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62038b7-0937-41fc-b412-185d813da326 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=089f9f34b5904f0daadc237cd6c1155d, role_id=c5260227d3ff4cbf956c47e3590a0ba1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:15.909279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62038b7-0937-41fc-b412-185d813da326 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:15.938111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 154/309] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Sep 22 02:32:15 2022] PUT /identity/v3/system/users/089f9f34b5904f0daadc237cd6c1155d/roles/c5260227d3ff4cbf956c47e3590a0ba1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:16.025764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47fc7-5c0f-4629-93f3-552bce1da188 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:16.111461 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801a52-62c5-4c59-ad71-cbc33ab50c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:16.112106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801a52-62c5-4c59-ad71-cbc33ab50c9a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:16.112391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801a52-62c5-4c59-ad71-cbc33ab50c9a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:16.112652 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801a52-62c5-4c59-ad71-cbc33ab50c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:16.113430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801a52-62c5-4c59-ad71-cbc33ab50c9a None admin] RBAC: Adding query filter params (role.id=80ad5d7540594fb487d2f2b65c7e7532, user.id=1519569d93ac4dcf9b62aea67dbd9271, scope.system=all) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:16.113768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801a52-62c5-4c59-ad71-cbc33ab50c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:16.115228 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801a52-62c5-4c59-ad71-cbc33ab50c9a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:16.122445 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 156/310] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 22 02:32:15 2022] GET /identity/v3/role_assignments?user.id=1519569d93ac4dcf9b62aea67dbd9271&scope.system=all&role.id=80ad5d7540594fb487d2f2b65c7e7532 => generated 226 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:16.504052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6efa0-960d-4c62-a9d6-23d4eb228c51 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:16.504350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6efa0-960d-4c62-a9d6-23d4eb228c51 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:16.504737 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6efa0-960d-4c62-a9d6-23d4eb228c51 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:16.506387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 155/311] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:16.514012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d4527-0fc1-43b1-b6d1-ea040380c32a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:16.514280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d4527-0fc1-43b1-b6d1-ea040380c32a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:16.514582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d4527-0fc1-43b1-b6d1-ea040380c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:16.534792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fa1d4527-0fc1-43b1-b6d1-ea040380c32a None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:16.536007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fa1d4527-0fc1-43b1-b6d1-ea040380c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:16.665196 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 157/312] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:16.959921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6efa0-960d-4c62-a9d6-23d4eb228c51 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:16.964214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:17.220641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6efa0-960d-4c62-a9d6-23d4eb228c51 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:17.294148 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:17.295081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:17.295522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:17.295949 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:17.313994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:17.319840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:17.320811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:17.321635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:17.324076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 156/313] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:17.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d4527-0fc1-43b1-b6d1-ea040380c32a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:17.400889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:17.479926 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d4527-0fc1-43b1-b6d1-ea040380c32a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:17.520597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:17.521523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:17.522195 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:17.522653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:17.523523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:17.524186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:17.525891 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:17.536386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 158/314] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:17.543859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:17.630190 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:17.680801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d687-3b26-49cc-8662-b4b5212ead2f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:17.721936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:17.722918 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:17.723372 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:17.723836 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] PATH_INFO: `/v3/users/bd85e92c0c5f4f1da0eb394ed79088a3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:17.725238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] RBAC: Authorizing `identity:get_user(user_id=bd85e92c0c5f4f1da0eb394ed79088a3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:17.727017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:17.735632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 157/315] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:17 2022] GET /identity/v3/users/bd85e92c0c5f4f1da0eb394ed79088a3 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:17.737270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:17.850216 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:17.852917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362a817-048d-416d-bc91-54b1d63e5414 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:17.893670 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:17.894400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:17.894729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:17.895060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:17.977253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:17.977253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:18.097822 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:18.102247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 159/316] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:18.108723 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:18.230269 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a820f-c5c3-4066-b899-b935219cef0b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:18.273324 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa30b12-d0a6-4990-a572-981dec27f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:18.277117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30b12-d0a6-4990-a572-981dec27f444 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:18.277758 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30b12-d0a6-4990-a572-981dec27f444 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:18.278262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30b12-d0a6-4990-a572-981dec27f444 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:18.281912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa30b12-d0a6-4990-a572-981dec27f444 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:18.283750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa30b12-d0a6-4990-a572-981dec27f444 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:18.290069 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:18.290069 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 158/317] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:18 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:18.298686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:18.421590 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d261-fbaa-44f6-898f-3707956681a3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:18.462764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5951-d0f5-47c7-b932-dc3f4e155949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:18.463746 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5951-d0f5-47c7-b932-dc3f4e155949 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:18.464217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5951-d0f5-47c7-b932-dc3f4e155949 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:18.464698 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5951-d0f5-47c7-b932-dc3f4e155949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:18.465733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae5951-d0f5-47c7-b932-dc3f4e155949 None admin] RBAC: Adding query filter params (role.id=80ad5d7540594fb487d2f2b65c7e7532, scope.project.id=6f29f91d86c343dca7b2eab39e67a922, user.id=bd85e92c0c5f4f1da0eb394ed79088a3) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:18.466242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae5951-d0f5-47c7-b932-dc3f4e155949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:18.467915 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae5951-d0f5-47c7-b932-dc3f4e155949 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:18.479867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 160/318] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:18 2022] GET /identity/v3/role_assignments?user.id=bd85e92c0c5f4f1da0eb394ed79088a3&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=80ad5d7540594fb487d2f2b65c7e7532 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:18.488175 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62a72-f230-4fa6-811a-269e69fa7189 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:18.488663 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62a72-f230-4fa6-811a-269e69fa7189 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:18.489154 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62a72-f230-4fa6-811a-269e69fa7189 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:18.491855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 159/319] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:18.504659 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfe6f-3d88-4f24-99bd-97e6c0c9d6e2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:18.505121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfe6f-3d88-4f24-99bd-97e6c0c9d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:18.505639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfe6f-3d88-4f24-99bd-97e6c0c9d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:18.540095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-178bfe6f-3d88-4f24-99bd-97e6c0c9d6e2 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:18.549691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-178bfe6f-3d88-4f24-99bd-97e6c0c9d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:18.706457 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:18.740889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 161/320] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:18.812952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09cfea-e675-4c26-9a27-e586b1dbe17f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:18.813544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09cfea-e675-4c26-9a27-e586b1dbe17f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:18.814095 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09cfea-e675-4c26-9a27-e586b1dbe17f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:18.815983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 160/321] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:18.822823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156c94-e0d5-494f-be3b-03e548d68bac None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:18.823483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156c94-e0d5-494f-be3b-03e548d68bac None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:18.823951 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156c94-e0d5-494f-be3b-03e548d68bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:18.845346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-83156c94-e0d5-494f-be3b-03e548d68bac None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:18.847039 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-83156c94-e0d5-494f-be3b-03e548d68bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:18.974640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 162/322] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:19.145456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09cfea-e675-4c26-9a27-e586b1dbe17f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:19.268642 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09cfea-e675-4c26-9a27-e586b1dbe17f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:19.309502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:19.310540 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:19.310967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:19.311435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:19.312859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:19.314530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:19.321088 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 161/323] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:19.324016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83156c94-e0d5-494f-be3b-03e548d68bac None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:19.452123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:19.464511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83156c94-e0d5-494f-be3b-03e548d68bac None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:19.503097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:19.526417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98b2c5-5449-41f4-beb0-5de2260cb3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:19.526950 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98b2c5-5449-41f4-beb0-5de2260cb3a4 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:19.527216 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98b2c5-5449-41f4-beb0-5de2260cb3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:19.527671 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98b2c5-5449-41f4-beb0-5de2260cb3a4 None admin] PATH_INFO: `/v3/groups` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:19.528987 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98b2c5-5449-41f4-beb0-5de2260cb3a4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:19.530996 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98b2c5-5449-41f4-beb0-5de2260cb3a4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:19.554727 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 163/324] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Sep 22 02:32:19 2022] POST /identity/v3/groups => generated 226 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:19.564284 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c2175-756f-497e-be4d-de9f199b3a8b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:19.565138 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c2175-756f-497e-be4d-de9f199b3a8b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:19.565412 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c2175-756f-497e-be4d-de9f199b3a8b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:19.568180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 164/325] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:19.577851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c19e0-8712-41d4-b466-fb18200e8f01 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:19.578387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c19e0-8712-41d4-b466-fb18200e8f01 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:19.578940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c19e0-8712-41d4-b466-fb18200e8f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:19.602138 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4c5c19e0-8712-41d4-b466-fb18200e8f01 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:19.604019 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4c5c19e0-8712-41d4-b466-fb18200e8f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:19.607501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:19.702324 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2319-178d-4a6f-8b72-fe98b83c359d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:19.716105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 165/326] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:19.770456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:19.771127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:19.771415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:19.771685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:19.784756 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:19.792835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:19.796779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:19.797569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 162/327] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:19.804538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c19e0-8712-41d4-b466-fb18200e8f01 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:19.966660 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c19e0-8712-41d4-b466-fb18200e8f01 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:19.996151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:20.021686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:20.022233 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:20.022724 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:20.023160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:20.024370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:20.025459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:20.032877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:20.049107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 166/328] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:20.060534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:20.075391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:20.204755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bd4fc-1a79-4e41-abf5-3d3140e4e817 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:20.237113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:20.264327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:20.266196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:20.267257 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:20.267867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] PATH_INFO: `/v3/users/1519569d93ac4dcf9b62aea67dbd9271` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:20.270789 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] RBAC: Authorizing `identity:get_user(user_id=1519569d93ac4dcf9b62aea67dbd9271)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:20.274356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:20.285513 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 163/329] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:20 2022] GET /identity/v3/users/1519569d93ac4dcf9b62aea67dbd9271 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:20.293921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:20.303874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc7a8-adbd-4033-9f2f-a684626a3f98 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:20.421717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:20.421717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:20.422259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:20.422637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:20.448899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:20.459152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:20.460114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:20.460917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:20.461518 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 167/330] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:20.471095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:20.492333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5107b4-e835-40ab-8fb6-7f146c09ada6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:20.587381 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:20.638427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:20.639667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:20.640138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:20.640770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] PATH_INFO: `/v3/system/users/1519569d93ac4dcf9b62aea67dbd9271/roles/80ad5d7540594fb487d2f2b65c7e7532` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:20.645712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1519569d93ac4dcf9b62aea67dbd9271, role_id=80ad5d7540594fb487d2f2b65c7e7532)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:20.656654 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:20.678419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 164/331] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Sep 22 02:32:20 2022] PUT /identity/v3/system/users/1519569d93ac4dcf9b62aea67dbd9271/roles/80ad5d7540594fb487d2f2b65c7e7532 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:20.757675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf197-0102-49ba-ae4e-c85236d71463 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:20.835616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:20.836603 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:20.837069 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:20.838194 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:20.839906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:20.839906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:20.842234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:20.860547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 168/332] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:20.876737 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:21.010792 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:21.115989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d9d26-97d6-4756-8873-06125284e9ac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:21.195652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4dda-ee9c-4209-bbf1-a9424fa8eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:21.196313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4dda-ee9c-4209-bbf1-a9424fa8eb64 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:21.197121 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4dda-ee9c-4209-bbf1-a9424fa8eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:21.197693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4dda-ee9c-4209-bbf1-a9424fa8eb64 None admin] PATH_INFO: `/v3/users/089f9f34b5904f0daadc237cd6c1155d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:21.198924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf4dda-ee9c-4209-bbf1-a9424fa8eb64 None admin] RBAC: Authorizing `identity:get_user(user_id=089f9f34b5904f0daadc237cd6c1155d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:21.201024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf4dda-ee9c-4209-bbf1-a9424fa8eb64 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:21.209852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 165/333] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:20 2022] GET /identity/v3/users/089f9f34b5904f0daadc237cd6c1155d => generated 293 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:21.215594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:21.367425 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:21.379551 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ac17-0a0f-467e-9940-10faadc327f1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:21.422986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5bcc5-e64c-4ee2-8b8b-3e262d542e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:21.423885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5bcc5-e64c-4ee2-8b8b-3e262d542e2f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:21.424354 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5bcc5-e64c-4ee2-8b8b-3e262d542e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:21.424795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5bcc5-e64c-4ee2-8b8b-3e262d542e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:21.425754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5bcc5-e64c-4ee2-8b8b-3e262d542e2f None admin] RBAC: Adding query filter params (role.id=c5260227d3ff4cbf956c47e3590a0ba1, user.id=089f9f34b5904f0daadc237cd6c1155d, scope.system=all) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:21.426241 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5bcc5-e64c-4ee2-8b8b-3e262d542e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:21.427930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5bcc5-e64c-4ee2-8b8b-3e262d542e2f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:21.449768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 169/334] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 22 02:32:21 2022] GET /identity/v3/role_assignments?user.id=089f9f34b5904f0daadc237cd6c1155d&scope.system=all&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:23.361536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4900693-6b67-4e08-ab62-ff4aeab297d8 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:23.361536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4900693-6b67-4e08-ab62-ff4aeab297d8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:23.361536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4900693-6b67-4e08-ab62-ff4aeab297d8 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:23.361536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 166/335] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:23.368146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6ee2-c035-4d8b-a28c-4fd98a2a03bd None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:23.369454 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6ee2-c035-4d8b-a28c-4fd98a2a03bd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:23.369454 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6ee2-c035-4d8b-a28c-4fd98a2a03bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:23.402516 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4fba6ee2-c035-4d8b-a28c-4fd98a2a03bd None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:23.403730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4fba6ee2-c035-4d8b-a28c-4fd98a2a03bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:23.566477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 170/336] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:24.365062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4900693-6b67-4e08-ab62-ff4aeab297d8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:24.646611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4900693-6b67-4e08-ab62-ff4aeab297d8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:24.688633 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:24.705094 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:24.705787 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:24.706066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:24.707228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:24.732384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:24.737634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:24.739294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:24.740743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 167/337] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:24.749739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6ee2-c035-4d8b-a28c-4fd98a2a03bd None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:25.039641 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:25.083803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6ee2-c035-4d8b-a28c-4fd98a2a03bd None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:25.215096 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708d8eb-eef9-4b49-8bee-cfb12924593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:25.216420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d8eb-eef9-4b49-8bee-cfb12924593b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:25.217091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d8eb-eef9-4b49-8bee-cfb12924593b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:25.217821 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d8eb-eef9-4b49-8bee-cfb12924593b None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:25.219157 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708d8eb-eef9-4b49-8bee-cfb12924593b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:25.219890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708d8eb-eef9-4b49-8bee-cfb12924593b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:25.222480 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708d8eb-eef9-4b49-8bee-cfb12924593b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:25.245296 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 171/338] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:25.254967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:25.334662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4d11-c663-4248-841a-431e1723c91c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:25.335751 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4d11-c663-4248-841a-431e1723c91c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:25.336426 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4d11-c663-4248-841a-431e1723c91c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:25.339091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 172/339] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:25.352349 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254e70-b5a6-4c5b-ac17-d78b3fd28c14 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:25.353233 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254e70-b5a6-4c5b-ac17-d78b3fd28c14 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:25.356600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254e70-b5a6-4c5b-ac17-d78b3fd28c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:25.406018 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96818ed7-a4ac-4581-9afe-8c98b5f48435 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:25.417484 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2c254e70-b5a6-4c5b-ac17-d78b3fd28c14 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:25.426926 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2c254e70-b5a6-4c5b-ac17-d78b3fd28c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:25.499271 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f257-68f9-4a3f-a030-1937dde721d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:25.500269 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f257-68f9-4a3f-a030-1937dde721d8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:25.506224 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f257-68f9-4a3f-a030-1937dde721d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:25.506809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f257-68f9-4a3f-a030-1937dde721d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:25.655667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:25.677447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 173/340] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:25.678479 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f257-68f9-4a3f-a030-1937dde721d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:25.680545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f257-68f9-4a3f-a030-1937dde721d8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:25.833952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 168/341] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:25.847642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c254e70-b5a6-4c5b-ac17-d78b3fd28c14 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:25.941826 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca8a4-8e86-45bd-b5b8-6343f139ce6a None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:25.942155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca8a4-8e86-45bd-b5b8-6343f139ce6a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:25.942391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca8a4-8e86-45bd-b5b8-6343f139ce6a None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:25.943767 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 169/342] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:25.953333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b9e-597b-4bbc-9116-0a65855548d7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:25.953712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b9e-597b-4bbc-9116-0a65855548d7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:25.954000 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b9e-597b-4bbc-9116-0a65855548d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:25.999299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f5e59b9e-597b-4bbc-9116-0a65855548d7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:26.000697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f5e59b9e-597b-4bbc-9116-0a65855548d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:26.048017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:26.136455 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c254e70-b5a6-4c5b-ac17-d78b3fd28c14 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:26.140674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 170/343] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:26.142142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43a430-42ca-4373-a961-c7e15b32a218 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:26.145719 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43a430-42ca-4373-a961-c7e15b32a218 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:26.145719 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43a430-42ca-4373-a961-c7e15b32a218 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:26.145719 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 171/344] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:26.151674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78033689-685c-45a6-913f-ab127ba7dbe1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:26.151981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78033689-685c-45a6-913f-ab127ba7dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:26.152228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78033689-685c-45a6-913f-ab127ba7dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:26.186923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-78033689-685c-45a6-913f-ab127ba7dbe1 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:26.188166 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-78033689-685c-45a6-913f-ab127ba7dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:26.215947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:26.255411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:26.256008 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:26.256290 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:26.256565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:26.263128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:26.265463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:26.267668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 174/345] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:25 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:26.269836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:26.369866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 172/346] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:26.371012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78033689-685c-45a6-913f-ab127ba7dbe1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:26.467133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b48bb-37ac-4646-8565-8460d37476b3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:26.537581 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:26.538703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:26.539129 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:26.539821 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:26.561041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:26.570908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:26.572474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:26.573253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:26.573877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78033689-685c-45a6-913f-ab127ba7dbe1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:26.576047 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 175/347] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:26.586757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:26.595924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:26.682600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:26.683294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:26.683573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:26.683848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:26.705734 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:26.705734 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:26.706477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 173/348] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:26 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:26.714131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:26.755359 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:26.870863 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66afa0-6b00-48ce-a227-051c355f5a9b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:26.948935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fa1ad-1748-40fe-9024-2dcfbfc66578 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:26.953835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:26.953835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:26.955375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:26.955726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:26.956476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:26.956794 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:26.961099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:26.974181 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 176/349] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:26.975338 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:27.001121 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0573e-fd5f-4845-8cac-8bb2ac31f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:27.002106 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0573e-fd5f-4845-8cac-8bb2ac31f9ee None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.002569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0573e-fd5f-4845-8cac-8bb2ac31f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.002997 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0573e-fd5f-4845-8cac-8bb2ac31f9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.003904 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0573e-fd5f-4845-8cac-8bb2ac31f9ee None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=33030c4724a540db9ef3256cf305f68c) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:27.004368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0573e-fd5f-4845-8cac-8bb2ac31f9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:27.006091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0573e-fd5f-4845-8cac-8bb2ac31f9ee None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:27.014978 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 174/350] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:26 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:27.016578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f711d-1660-454e-a427-47c0529d1d35 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.017072 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f711d-1660-454e-a427-47c0529d1d35 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.017542 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f711d-1660-454e-a427-47c0529d1d35 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.019488 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 175/351] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:27.020512 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f711d-1660-454e-a427-47c0529d1d35 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:27.115733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:27.147474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:27.171572 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ea4b-1ed8-4194-9062-b8c0c7fb2922 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:27.194196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f711d-1660-454e-a427-47c0529d1d35 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:27.221126 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:27.222012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.222123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.222375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.239283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:27.244817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:27.245949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:27.246881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 177/352] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:27.248212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:27.255135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908ffea-1b7e-42ee-a688-0c8b1f77fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:27.255806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ffea-1b7e-42ee-a688-0c8b1f77fc1a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.256144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ffea-1b7e-42ee-a688-0c8b1f77fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.256366 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ffea-1b7e-42ee-a688-0c8b1f77fc1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.271750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908ffea-1b7e-42ee-a688-0c8b1f77fc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d908ffea-1b7e-42ee-a688-0c8b1f77fc1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:27.279012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:27.279956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:27.280755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 176/353] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:27.281393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb78ec-1fad-4862-931b-202789d5fab3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.282320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb78ec-1fad-4862-931b-202789d5fab3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.290861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb78ec-1fad-4862-931b-202789d5fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.324082 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3ecb78ec-1fad-4862-931b-202789d5fab3 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:27.325685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3ecb78ec-1fad-4862-931b-202789d5fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:27.394018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcaf03-9a2d-4ec9-8d37-03a4a78b2409 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:27.427498 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 177/354] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:27.429108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ea26-e838-4b31-9cbb-e402ed3cca32 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.429592 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ea26-e838-4b31-9cbb-e402ed3cca32 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.430097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ea26-e838-4b31-9cbb-e402ed3cca32 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.431658 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 178/355] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:27.432624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1ea26-e838-4b31-9cbb-e402ed3cca32 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:27.441693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:27.467429 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a3a14-8145-4ba3-a8cd-05d76e68a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:27.467429 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3a14-8145-4ba3-a8cd-05d76e68a5fd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.467429 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3a14-8145-4ba3-a8cd-05d76e68a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.467748 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3a14-8145-4ba3-a8cd-05d76e68a5fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.538062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:27.566238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a3a14-8145-4ba3-a8cd-05d76e68a5fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:27.568206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a3a14-8145-4ba3-a8cd-05d76e68a5fd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:27.600212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1ea26-e838-4b31-9cbb-e402ed3cca32 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:27.682304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:27.683099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.683951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.684241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.684943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:27.685245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:27.689452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:27.700377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 179/356] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:27.702849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:27.771258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 178/357] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:27.771258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fd77b-decf-4fa4-a05f-bf6f2f64d8f7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.771258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fd77b-decf-4fa4-a05f-bf6f2f64d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.771258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fd77b-decf-4fa4-a05f-bf6f2f64d8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.802880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f14fd77b-decf-4fa4-a05f-bf6f2f64d8f7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:27.804990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f14fd77b-decf-4fa4-a05f-bf6f2f64d8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:27.838164 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:27.862739 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950c91-c0f0-44e3-b522-6a4aaef60ca2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:27.900210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:27.920631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:27.921440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:27.925435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:27.925435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:27.925435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:27.925435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:27.925435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:27.936092 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 180/358] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:27.937452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:27.970466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 179/359] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:27.972749 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fd77b-decf-4fa4-a05f-bf6f2f64d8f7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:28.075344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db1b98-2cac-4111-9d55-80bb80fc2568 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:28.125306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:28.125306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:28.125306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:28.125921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] PATH_INFO: `/v3/users/1519569d93ac4dcf9b62aea67dbd9271` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:28.126915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] RBAC: Authorizing `identity:get_user(user_id=1519569d93ac4dcf9b62aea67dbd9271)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:28.128374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:28.130164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 181/360] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:32:27 2022] GET /identity/v3/users/1519569d93ac4dcf9b62aea67dbd9271 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:28.134497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:28.211532 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:28.235252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fd77b-decf-4fa4-a05f-bf6f2f64d8f7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:28.271995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002a49-568e-4ef7-bd2f-9fb0dfca1b87 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:28.308450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:28.314571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:28.314835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:28.315382 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:28.317946 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:28.320285 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:28.321865 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 180/361] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:27 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:28.322780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:28.342342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:28.344019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:28.345236 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:28.346361 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:28.370760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:28.371011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:28.377247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:28.379130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 182/362] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:28.380659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:28.539642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4d791-c2db-481c-bc5d-a0e98faa1bcc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:28.603938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823f83-9e4d-464f-b95e-6dc4d59d6192 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:28.628336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:28.637709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:28.638015 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:28.638514 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:28.638999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:28.675003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:28.676070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:28.676448 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:28.676825 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:28.677818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] RBAC: Adding query filter params (role.id=80ad5d7540594fb487d2f2b65c7e7532, user.id=1519569d93ac4dcf9b62aea67dbd9271, scope.system=all) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:28.678465 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:28.681040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:28.707864 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 183/363] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 22 02:32:28 2022] GET /identity/v3/role_assignments?user.id=1519569d93ac4dcf9b62aea67dbd9271&scope.system=all&role.id=80ad5d7540594fb487d2f2b65c7e7532 => generated 510 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:28.711630 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:28.785307 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:28.787532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:28.839726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:28.864037 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11700f34-7d70-4a92-8a45-b1151dee5e06 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:28.913168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:28.913868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:28.918362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:28.918635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:28.921411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:28.924787 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:28.927524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 184/364] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:28 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:28.929049 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:29.023889 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:29.027280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 181/365] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:29.029155 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:29.198779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7b14c-ee5b-4014-ba22-4bf1b00c68f8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:29.208765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb56ef-9fc2-4b14-884a-d2d28f9b2b36 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:29.262906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:29.266478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:29.267381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:29.267812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:29.268257 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:29.288440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:29.288917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:29.289902 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:29.290935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:29.291783 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:29.292225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:29.294143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:29.300777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:29.306982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 182/366] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:29.308280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:29.319108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:29.320173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:29.321080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:29.323956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 185/367] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:29.326245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:29.520520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b5c4d-7698-48de-85a9-1920c005f489 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:29.528994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:29.566966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed2d7-fa9f-49c7-827c-599b61298f13 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:29.626588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:29.627602 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:29.627602 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:29.627784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:29.630616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:29.632029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:29.634103 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 186/368] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:29 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:29.634602 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:29.656436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:29.657556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:29.658187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:29.659006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:29.660262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=33030c4724a540db9ef3256cf305f68c) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:29.660573 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:29.666727 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:29.683366 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 183/369] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:29 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 260 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:29.684787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:29.811465 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520800f-b9a0-4e4d-91cf-27b7424cb12c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:29.835367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:29.867164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81e910-7702-4fcb-ad2b-af2f8970b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:29.868649 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e910-7702-4fcb-ad2b-af2f8970b64c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:29.869185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e910-7702-4fcb-ad2b-af2f8970b64c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:29.869822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e910-7702-4fcb-ad2b-af2f8970b64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:29.926916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:29.937154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbba8b-fe40-40b2-ab15-b2d8e3ddc85a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:29.974848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81e910-7702-4fcb-ad2b-af2f8970b64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:29.976930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81e910-7702-4fcb-ad2b-af2f8970b64c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:30.021808 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:30.023115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:30.024071 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:30.025643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:30.027234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:30.028164 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:30.031497 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:30.046710 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 184/370] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:30.048373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:30.142237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 187/371] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:30.144375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cd22d-d9e1-46a5-8edc-8d0d8a143b15 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:30.144824 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cd22d-d9e1-46a5-8edc-8d0d8a143b15 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:30.145306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cd22d-d9e1-46a5-8edc-8d0d8a143b15 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:30.150119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 188/372] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:30.150119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cd22d-d9e1-46a5-8edc-8d0d8a143b15 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:30.227020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68cdd-b877-4570-9f4d-de93ff711c28 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:30.246672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:30.292062 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:30.293418 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:30.294133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:30.294793 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:30.295835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:30.297344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:30.300392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:30.304177 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 185/373] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:30 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:30.305963 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:30.359510 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cd22d-d9e1-46a5-8edc-8d0d8a143b15 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:30.423374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:30.424709 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:30.425370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:30.426075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:30.466525 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3807ab-d953-4bb3-b44b-aacc9d4588ec None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:30.519926 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7981b-846f-4754-93a1-47d50934964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:30.521329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7981b-846f-4754-93a1-47d50934964f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:30.522086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7981b-846f-4754-93a1-47d50934964f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:30.522839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7981b-846f-4754-93a1-47d50934964f None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:30.528066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7981b-846f-4754-93a1-47d50934964f None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:30.530785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7981b-846f-4754-93a1-47d50934964f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:30.533961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 186/374] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:30 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:30.535795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14892-a474-4212-9f11-3a26f5c271c0 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:30.536264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14892-a474-4212-9f11-3a26f5c271c0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:30.536683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14892-a474-4212-9f11-3a26f5c271c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:30.560073 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:30.562728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:30.568052 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b2d14892-a474-4212-9f11-3a26f5c271c0 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:30.572171 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b2d14892-a474-4212-9f11-3a26f5c271c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:30.655950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:30.661296 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:30.708067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 189/375] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:30.709459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:30.710752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 187/376] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:30.712092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14892-a474-4212-9f11-3a26f5c271c0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:30.937814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14892-a474-4212-9f11-3a26f5c271c0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:30.994922 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:30.995687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:30.996784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:30.997083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:30.998343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:31.000379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:31.005905 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 188/377] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:30 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:31.007714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:31.086769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e0d7-59c8-491b-b161-ee21c4672796 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:31.117681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:31.238796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:31.239966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:31.240538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:31.241087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:31.242517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=6f29f91d86c343dca7b2eab39e67a922) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:31.245175 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:31.247789 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:31.259984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 190/378] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:30 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 260 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:31.261168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:31.275471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ec8bd-79f6-4b6c-bfed-32a30ac4b226 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:31.345485 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:31.419693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:31.420705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:31.421167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:31.421633 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] PATH_INFO: `/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:31.428836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] RBAC: Authorizing `identity:get_project(project_id=e37cfa01ad9247dab92fb4fc2b4b39f2)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:31.433762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:31.442021 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 189/379] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:31 2022] GET /identity/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2 => generated 344 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:31.442021 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:31.554403 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29738-c9f8-46f0-9eb8-f910bd469689 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:31.689035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:31.689985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:31.689985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:31.690258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:31.693691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=6f29f91d86c343dca7b2eab39e67a922) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:31.693691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:31.693691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:31.719800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 191/380] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:31 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 260 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:31.720786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:31.745614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5bb7-b30c-40eb-959f-9d2c31862db8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:31.822633 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:31.886866 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:31.887549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:31.887833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:31.891036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:31.913888 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:31.920100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:31.921792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:31.923107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:31.928567 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 190/381] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:31.950568 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:32.031753 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:32.042583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76784-9044-4b44-82c5-3c5708243fe6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:32.134933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:32.135516 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:32.135799 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:32.136824 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] PATH_INFO: `/v3/groups/32d26d34633b4bf2a8cb6858ae99bb2c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:32.155607 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] RBAC: Authorizing `identity:get_group(group_id=32d26d34633b4bf2a8cb6858ae99bb2c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:32.161261 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:32.170350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 192/382] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:31 2022] GET /identity/v3/groups/32d26d34633b4bf2a8cb6858ae99bb2c => generated 229 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:32.176085 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:32.239801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02482-805a-4cba-b149-6e8cdcfaed96 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:32.333696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c137d1-b151-4e5d-8ce2-65288a47fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:32.333696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c137d1-b151-4e5d-8ce2-65288a47fad1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:32.333696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c137d1-b151-4e5d-8ce2-65288a47fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:32.333696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c137d1-b151-4e5d-8ce2-65288a47fad1 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:32.334113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c137d1-b151-4e5d-8ce2-65288a47fad1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:32.334113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c137d1-b151-4e5d-8ce2-65288a47fad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:32.334113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c137d1-b151-4e5d-8ce2-65288a47fad1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:32.355708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 191/383] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:32.359450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38226cda-95bc-4110-bd66-01d46a00d1ea None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:32.360012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38226cda-95bc-4110-bd66-01d46a00d1ea None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:32.360488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38226cda-95bc-4110-bd66-01d46a00d1ea None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:32.370309 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 192/384] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:32.371857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38226cda-95bc-4110-bd66-01d46a00d1ea None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:32.449267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9603e-1eb0-4326-9251-41607249f740 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:32.462277 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:32.503086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38226cda-95bc-4110-bd66-01d46a00d1ea None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:32.558860 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d683d-2e8e-4880-9284-f6f5ddefb252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:32.559879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d683d-2e8e-4880-9284-f6f5ddefb252 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:32.560386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d683d-2e8e-4880-9284-f6f5ddefb252 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:32.560861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d683d-2e8e-4880-9284-f6f5ddefb252 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:32.562396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d683d-2e8e-4880-9284-f6f5ddefb252 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:32.564320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d683d-2e8e-4880-9284-f6f5ddefb252 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:32.574160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 193/385] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:32 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:32.574160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99616c-7a90-45fb-812a-e67f876deeeb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:32.574160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99616c-7a90-45fb-812a-e67f876deeeb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:32.574160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99616c-7a90-45fb-812a-e67f876deeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:32.576425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:32.577166 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:32.577449 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:32.577749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:32.585693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] RBAC: Adding query filter params (group.id=32d26d34633b4bf2a8cb6858ae99bb2c, role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=e37cfa01ad9247dab92fb4fc2b4b39f2) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:32.585693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:32.585693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:32.604141 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 193/386] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:32 2022] GET /identity/v3/role_assignments?group.id=32d26d34633b4bf2a8cb6858ae99bb2c&scope.project.id=e37cfa01ad9247dab92fb4fc2b4b39f2&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 260 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:32.605231 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:32.622350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9b99616c-7a90-45fb-812a-e67f876deeeb None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:32.623677 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9b99616c-7a90-45fb-812a-e67f876deeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:32.665711 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:32.821141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 194/387] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:32.865278 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c9c12-a68f-418c-9ef7-66e19ac99ad8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:32.954616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:32.955580 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:32.956004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:32.956497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:32.963181 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:32.965012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:32.967113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 194/388] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:32 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:32.995012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99616c-7a90-45fb-812a-e67f876deeeb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:33.076770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:33.197466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99616c-7a90-45fb-812a-e67f876deeeb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:33.252264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:33.296919 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:33.298106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:33.298580 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:33.299112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:33.307672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] RBAC: Authorizing `identity:create_grant(project_id=33030c4724a540db9ef3256cf305f68c, group_id=f678851cbe2546a5876e9321e7c0b0f3, role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:33.312438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:33.350476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 195/389] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 22 02:32:32 2022] PUT /identity/v3/projects/33030c4724a540db9ef3256cf305f68c/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/80756a2a2a9a47918e65c4ed873146eb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:33.538954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:33.548946 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c54df-355a-4c08-ba07-f9e500dcded6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:33.639905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:33.640982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:33.641465 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:33.642034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:33.670367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:33.681392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:33.683208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:33.687272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 195/390] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:33.694855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:33.893867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:33.910718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82342b-5c23-43b7-b440-3d7dda015a87 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:33.996078 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:33.997117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:33.997552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:33.998011 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:33.999100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:33.999575 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:34.002152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:34.027558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 196/391] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:34.033514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:34.256954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a014-fa30-487f-ac34-c9f6c1dde34c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:34.319572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:34.320243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:34.323369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:34.323369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:34.323369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:34.323792 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:34.329900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 196/392] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:34 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:34.335531 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:34.648308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaacdd-ff5b-4e86-bdf4-99795e6d2b2d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:34.737024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bceb82-82b2-4203-838d-b66da4caad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:34.737870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bceb82-82b2-4203-838d-b66da4caad83 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:34.738162 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bceb82-82b2-4203-838d-b66da4caad83 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:34.738435 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bceb82-82b2-4203-838d-b66da4caad83 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:34.742446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bceb82-82b2-4203-838d-b66da4caad83 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:34.744536 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bceb82-82b2-4203-838d-b66da4caad83 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:34.746341 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 197/393] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:34 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:34.752503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:34.786705 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:34.864060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141ce2-bce6-4704-b8fa-9f73d4b93a6e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:34.864562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141ce2-bce6-4704-b8fa-9f73d4b93a6e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:34.867843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141ce2-bce6-4704-b8fa-9f73d4b93a6e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:34.867843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 198/394] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:32:34.883440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27c24b-0fed-41ce-a10b-5746929f4d69 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:34.889686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27c24b-0fed-41ce-a10b-5746929f4d69 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:34.889686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27c24b-0fed-41ce-a10b-5746929f4d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:34.947571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4d27c24b-0fed-41ce-a10b-5746929f4d69 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:34.949571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4d27c24b-0fed-41ce-a10b-5746929f4d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:35.001689 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca037f3c-ac3e-424d-b0cc-a856250f0f14 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:35.034794 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:35.114344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7320e1-b0af-4939-937c-800213de1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:35.117685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7320e1-b0af-4939-937c-800213de1727 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:35.117685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7320e1-b0af-4939-937c-800213de1727 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:35.117685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7320e1-b0af-4939-937c-800213de1727 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/c5260227d3ff4cbf956c47e3590a0ba1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:35.128138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7320e1-b0af-4939-937c-800213de1727 None admin] RBAC: Authorizing `identity:create_grant(project_id=33030c4724a540db9ef3256cf305f68c, group_id=f678851cbe2546a5876e9321e7c0b0f3, role_id=c5260227d3ff4cbf956c47e3590a0ba1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:35.130815 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7320e1-b0af-4939-937c-800213de1727 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:35.168032 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 197/395] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 22 02:32:34 2022] PUT /identity/v3/projects/33030c4724a540db9ef3256cf305f68c/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/c5260227d3ff4cbf956c47e3590a0ba1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:32:35.209539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 199/396] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:35.657992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc03133-87b1-4eee-bbf3-9f5354b7bec3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:35.658446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc03133-87b1-4eee-bbf3-9f5354b7bec3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:35.658931 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc03133-87b1-4eee-bbf3-9f5354b7bec3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:35.661610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 198/397] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:35.668974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bce09-da62-441a-9d4a-387d81d80a36 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:35.669815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bce09-da62-441a-9d4a-387d81d80a36 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:35.669949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bce09-da62-441a-9d4a-387d81d80a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:35.702252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e94bce09-da62-441a-9d4a-387d81d80a36 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:35.703482 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e94bce09-da62-441a-9d4a-387d81d80a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:35.873543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 200/398] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:36.051858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc03133-87b1-4eee-bbf3-9f5354b7bec3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:36.182651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:36.208024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc03133-87b1-4eee-bbf3-9f5354b7bec3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:36.265410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:36.266114 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:36.266402 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:36.266672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:36.290888 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:36.296024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:36.297712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:36.299740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 199/399] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:36.306319 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bce09-da62-441a-9d4a-387d81d80a36 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:36.506476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:36.562835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:36.599838 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bce09-da62-441a-9d4a-387d81d80a36 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:36.763954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:36.767870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:36.770421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:36.773181 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:36.774765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:36.775879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:36.779624 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:36.815618 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 201/400] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:36.827364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:36.901708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306cda-0ba7-414b-98a6-e66c97e9ffb8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:37.025699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9271e-d124-4b73-a7af-a2e709cf05e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:37.025699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9271e-d124-4b73-a7af-a2e709cf05e3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.027756 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9271e-d124-4b73-a7af-a2e709cf05e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.028358 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9271e-d124-4b73-a7af-a2e709cf05e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.065428 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9271e-d124-4b73-a7af-a2e709cf05e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a3b9271e-d124-4b73-a7af-a2e709cf05e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:37.076038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:37.077842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:37.079387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 200/401] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 573 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:37.081463 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1577b-99f9-4a36-aeb3-cb9794c5ebe2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.081463 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1577b-99f9-4a36-aeb3-cb9794c5ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.082007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1577b-99f9-4a36-aeb3-cb9794c5ebe2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.084274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 201/402] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:37.098595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1577b-99f9-4a36-aeb3-cb9794c5ebe2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:37.119259 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:37.132486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa5e92-1576-4a62-b95f-4a69069940cc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:37.179291 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13308e-c967-434f-bef1-f7155bcec293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:37.180424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13308e-c967-434f-bef1-f7155bcec293 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.180941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13308e-c967-434f-bef1-f7155bcec293 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.182914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13308e-c967-434f-bef1-f7155bcec293 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.186523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13308e-c967-434f-bef1-f7155bcec293 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:37.188756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13308e-c967-434f-bef1-f7155bcec293 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:37.194499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 202/403] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:36 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:37.196366 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1e7a0-39d2-4eb2-9e30-2e3d697a1877 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.196865 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1e7a0-39d2-4eb2-9e30-2e3d697a1877 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.197335 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1e7a0-39d2-4eb2-9e30-2e3d697a1877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.237630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-72e1e7a0-39d2-4eb2-9e30-2e3d697a1877 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:37.239255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-72e1e7a0-39d2-4eb2-9e30-2e3d697a1877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:37.262565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:37.397801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 203/404] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:37.397801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1e7a0-39d2-4eb2-9e30-2e3d697a1877 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:37.430105 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1577b-99f9-4a36-aeb3-cb9794c5ebe2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:37.551096 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:37.551748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.552026 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.552300 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.552986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:37.553295 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:37.554773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:37.579176 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 202/405] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:37.585257 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:37.617286 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1e7a0-39d2-4eb2-9e30-2e3d697a1877 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:37.701153 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:37.702352 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.702795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.703270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.708077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:37.715047 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:37.722917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 204/406] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:37 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:37.728068 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:37.751863 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:37.776896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:37.828911 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35353cbe-bc0d-4539-9cc0-f301d3be0db0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:37.894646 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efae25d-fe5a-47f7-b258-5b9f3ac28eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:37.895317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efae25d-fe5a-47f7-b258-5b9f3ac28eef None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.895598 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efae25d-fe5a-47f7-b258-5b9f3ac28eef None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.895879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efae25d-fe5a-47f7-b258-5b9f3ac28eef None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.897067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efae25d-fe5a-47f7-b258-5b9f3ac28eef None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:37.898571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efae25d-fe5a-47f7-b258-5b9f3ac28eef None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:37.900439 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 203/407] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:37 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:37.906135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439708f0-e50e-4923-9ded-dceb744652ed None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.906396 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439708f0-e50e-4923-9ded-dceb744652ed None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.906896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439708f0-e50e-4923-9ded-dceb744652ed None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.908153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 204/408] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:37.908993 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439708f0-e50e-4923-9ded-dceb744652ed None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:37.913941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd48c7-d033-45f4-a4c4-6c2fb2086102 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:37.977114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:37.977767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:37.978051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:37.978328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/c5260227d3ff4cbf956c47e3590a0ba1` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:37.980389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] RBAC: Authorizing `identity:create_grant(project_id=6f29f91d86c343dca7b2eab39e67a922, group_id=f678851cbe2546a5876e9321e7c0b0f3, role_id=c5260227d3ff4cbf956c47e3590a0ba1)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:37.981880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:38.013794 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 205/409] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 22 02:32:37 2022] PUT /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/c5260227d3ff4cbf956c47e3590a0ba1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:32:38.015385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:38.079542 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439708f0-e50e-4923-9ded-dceb744652ed None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:38.125302 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:38.146339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:38.155199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805f15-7402-4527-84eb-c753adfc0a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:38.156581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805f15-7402-4527-84eb-c753adfc0a0f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:38.157087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805f15-7402-4527-84eb-c753adfc0a0f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:38.158114 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805f15-7402-4527-84eb-c753adfc0a0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:38.173416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805f15-7402-4527-84eb-c753adfc0a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a1805f15-7402-4527-84eb-c753adfc0a0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:38.181078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:38.182066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:38.182898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:38.189900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 205/410] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:38.191778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f7743-9cf5-4edd-a499-ccc4a9312192 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:38.192313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f7743-9cf5-4edd-a499-ccc4a9312192 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:38.192821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f7743-9cf5-4edd-a499-ccc4a9312192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:38.199617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039849b-4903-4537-bd1a-08b5752029ae None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:38.217935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f34f7743-9cf5-4edd-a499-ccc4a9312192 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:38.220416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f34f7743-9cf5-4edd-a499-ccc4a9312192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:38.271711 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:38.272828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:38.273322 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:38.274623 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:38.276156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:38.278970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:38.284215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 206/411] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:38 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:38.285767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:38.344079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 206/412] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:38.349690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f7743-9cf5-4edd-a499-ccc4a9312192 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:38.545890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f7743-9cf5-4edd-a499-ccc4a9312192 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:38.554512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cca36-80ab-483d-b0f6-11cf4648fd6f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:38.572414 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:38.588545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7e176-af7b-41e9-8430-5ad0763e0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:38.589485 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7e176-af7b-41e9-8430-5ad0763e0936 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:38.589954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7e176-af7b-41e9-8430-5ad0763e0936 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:38.590509 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7e176-af7b-41e9-8430-5ad0763e0936 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:38.593098 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7e176-af7b-41e9-8430-5ad0763e0936 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f29f91d86c343dca7b2eab39e67a922, group_id=f678851cbe2546a5876e9321e7c0b0f3, role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:38.594771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7e176-af7b-41e9-8430-5ad0763e0936 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:38.614929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 207/413] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 22 02:32:38 2022] PUT /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922/groups/f678851cbe2546a5876e9321e7c0b0f3/roles/80756a2a2a9a47918e65c4ed873146eb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:38.617611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cae9c-71e0-4f1e-89d2-a8ca5361e7a0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:38.618808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cae9c-71e0-4f1e-89d2-a8ca5361e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:38.619232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cae9c-71e0-4f1e-89d2-a8ca5361e7a0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:38.621475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 208/414] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:38.630157 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632953a-2104-4fc3-b999-0f5724851027 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:38.630525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632953a-2104-4fc3-b999-0f5724851027 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:38.630811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632953a-2104-4fc3-b999-0f5724851027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:38.633053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:38.635219 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:38.636021 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:38.636750 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:38.638281 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:38.639051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:38.642599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:38.659658 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3632953a-2104-4fc3-b999-0f5724851027 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:38.660965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3632953a-2104-4fc3-b999-0f5724851027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:38.671561 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 207/415] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:38.681881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:38.690085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:38.796715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 209/416] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:38.942798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632953a-2104-4fc3-b999-0f5724851027 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:38.986407 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eab6c-640b-4295-ac9f-4957215653ac None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:39.073177 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:39.074229 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:39.075014 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:39.075312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] PATH_INFO: `/v3/groups/32d26d34633b4bf2a8cb6858ae99bb2c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:39.077851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] RBAC: Authorizing `identity:get_group(group_id=32d26d34633b4bf2a8cb6858ae99bb2c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:39.080230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:39.083473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 208/417] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:38 2022] GET /identity/v3/groups/32d26d34633b4bf2a8cb6858ae99bb2c => generated 229 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:39.119930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:39.201375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632953a-2104-4fc3-b999-0f5724851027 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:39.241395 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:39.287438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:39.322522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:39.324442 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:39.324442 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:39.324785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:39.346020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:39.356573 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:39.358263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:39.360251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 210/418] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:39.367413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edad51-345f-4e90-91b0-f19607268c36 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:39.372693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:39.458167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:39.459719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:39.460436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:39.461212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] PATH_INFO: `/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:39.464285 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] RBAC: Authorizing `identity:get_project(project_id=e37cfa01ad9247dab92fb4fc2b4b39f2)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:39.468329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:39.478665 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 209/419] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:39 2022] GET /identity/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2 => generated 344 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:39.478665 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:39.595926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599d21e-4c75-4bf3-b42a-a9088f531d04 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:39.666943 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4596a0-cf71-4211-9b1c-4ce21e59e993 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:39.671178 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:39.672651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:39.673407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:39.674159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:39.675570 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:39.676333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:39.679024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:39.696548 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 211/420] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:39.698386 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:39.746617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:39.747648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:39.748717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:39.749206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:39.766280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:39.766982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:39.776098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:39.789682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:39.791643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 210/421] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:39.793829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:39.922135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedbd2a-58b1-458c-947f-be112f57e61c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:39.996405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:39.998074 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:39.998938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:39.999686 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] PATH_INFO: `/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2/groups/32d26d34633b4bf2a8cb6858ae99bb2c/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.003334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] RBAC: Authorizing `identity:create_grant(project_id=e37cfa01ad9247dab92fb4fc2b4b39f2, group_id=32d26d34633b4bf2a8cb6858ae99bb2c, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:40.003813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff89e54-69b1-4b0c-9bb5-85d6041e2cd0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:40.007405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:40.035670 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 212/422] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 22 02:32:39 2022] PUT /identity/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2/groups/32d26d34633b4bf2a8cb6858ae99bb2c/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:32:40.038001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:40.068905 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:40.069992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:40.070467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:40.070945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.193092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:40.201398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:40.205080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:40.239778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:40.257075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e54dc7-57bc-44db-b498-edadd9d72951 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:40.323519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:40.325119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:40.326232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:40.327108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.328708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:40.329536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:40.332508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:40.349776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 213/423] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:40.365118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:40.439328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 211/424] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:40.449279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:40.588187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546f2c-6664-458c-9aa6-c1baa1ca8437 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:40.635456 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:40.644617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060869-c75a-40ee-adbf-4a10c5ce79db None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:40.654107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:40.655125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:40.655592 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:40.656050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.704172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:40.724318 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:40.725888 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:40.726637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:40.727885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.730328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:40.739533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:40.745755 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 212/425] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:40 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:40.766762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:40.804452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:40.807673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:40.924242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f147da6-cd5b-4c33-b4ff-ed11d271005a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:40.961548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00e549-a48b-4747-ba9a-13c680014d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:40.962672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00e549-a48b-4747-ba9a-13c680014d25 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:40.962944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00e549-a48b-4747-ba9a-13c680014d25 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:40.963258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00e549-a48b-4747-ba9a-13c680014d25 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.964516 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00e549-a48b-4747-ba9a-13c680014d25 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:40.966011 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00e549-a48b-4747-ba9a-13c680014d25 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:40.967966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 213/426] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:40 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:40.969222 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dabede-6632-422b-a178-8eb4ced20f0a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:40.969508 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dabede-6632-422b-a178-8eb4ced20f0a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:40.969811 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dabede-6632-422b-a178-8eb4ced20f0a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.971307 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 214/427] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:40.976776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c06ee-ea16-4d76-9ee0-5335d034846f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:40.977153 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c06ee-ea16-4d76-9ee0-5335d034846f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:40.977982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c06ee-ea16-4d76-9ee0-5335d034846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:40.997196 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9b7c06ee-ea16-4d76-9ee0-5335d034846f None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:40.998438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9b7c06ee-ea16-4d76-9ee0-5335d034846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:41.031221 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:41.041189 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 214/428] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:41.043634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:41.085785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 215/429] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:41.087955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c06ee-ea16-4d76-9ee0-5335d034846f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:41.185036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:41.304535 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830efdef-5930-442a-85ad-10f098415f62 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:41.422611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:41.424181 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:41.424934 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:41.425641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:41.434160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c06ee-ea16-4d76-9ee0-5335d034846f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:41.436147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=33030c4724a540db9ef3256cf305f68c) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:41.437045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:41.440126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:41.452234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 215/430] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:41 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 611 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:41.454360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:41.480191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:41.481119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:41.481550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:41.482042 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] PATH_INFO: `/v3/projects/33030c4724a540db9ef3256cf305f68c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:41.483502 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] RBAC: Authorizing `identity:get_project(project_id=33030c4724a540db9ef3256cf305f68c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:41.485356 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:41.487847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 216/431] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:41 2022] GET /identity/v3/projects/33030c4724a540db9ef3256cf305f68c => generated 298 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:41.498774 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:41.611090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:41.650822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736e8ac-1e87-4ab1-9c65-416ea981674c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:41.690425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:41.720024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:41.721482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:41.722268 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:41.722960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:41.744108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:41.754061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:41.755567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 02:32:41.756841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:41.761178 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 216/432] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:41.771015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:41.772098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b487-33ed-443f-91bd-575e2c0572d2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:41.815835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:41.816498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:41.816779 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:41.817047 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:41.818336 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:41.819803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:41.822366 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 217/433] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:41 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:41.837732 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:41.986848 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:41.991067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea5d8-095e-4680-83bf-3e1bd197adb6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:42.023700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38597f-235d-4621-abed-a09e8d6d32a6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:42.035092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:42.035890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.036060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.036423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.036986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=33030c4724a540db9ef3256cf305f68c) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:42.037294 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:42.038793 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:42.047622 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 218/434] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:41 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=33030c4724a540db9ef3256cf305f68c&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:42.098583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:42.100172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.100956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.101922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.104028 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:42.104908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:42.107907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:42.126883 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 217/435] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:42.132776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:42.281557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e9ef-3230-4907-87b2-1a49e8167135 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:42.323211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659857d-b144-4e93-8163-c5bbcae0bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:42.323853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659857d-b144-4e93-8163-c5bbcae0bfdd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.324129 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659857d-b144-4e93-8163-c5bbcae0bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.324402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659857d-b144-4e93-8163-c5bbcae0bfdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.364358 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:42.408124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659857d-b144-4e93-8163-c5bbcae0bfdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:42.409623 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659857d-b144-4e93-8163-c5bbcae0bfdd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:42.520774 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 219/436] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:42.526718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:42.536259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4475ae-5de1-4706-aa8d-d3ec5cf42c16 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.536683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4475ae-5de1-4706-aa8d-d3ec5cf42c16 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.537176 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4475ae-5de1-4706-aa8d-d3ec5cf42c16 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.540813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 220/437] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:42.549736 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5276-084e-4dff-9dbe-30d280776d54 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.550239 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5276-084e-4dff-9dbe-30d280776d54 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.550737 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5276-084e-4dff-9dbe-30d280776d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.580683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bd9e5276-084e-4dff-9dbe-30d280776d54 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:42.582799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bd9e5276-084e-4dff-9dbe-30d280776d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:42.589413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:42.681144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:42.698590 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 221/438] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:42.707247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e44208-6165-4bc3-80ba-bec427940b7c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:42.746218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67797e-e5c2-403c-a4d0-a8526d5669bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:42.746880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67797e-e5c2-403c-a4d0-a8526d5669bb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.747156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67797e-e5c2-403c-a4d0-a8526d5669bb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.747435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67797e-e5c2-403c-a4d0-a8526d5669bb None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.748706 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67797e-e5c2-403c-a4d0-a8526d5669bb None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:42.750280 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67797e-e5c2-403c-a4d0-a8526d5669bb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:42.752360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 218/439] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:42 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:42.757692 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5276-084e-4dff-9dbe-30d280776d54 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:42.818797 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16b039-2d3e-46b3-ae6f-2da543367a54 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.819698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16b039-2d3e-46b3-ae6f-2da543367a54 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.820254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16b039-2d3e-46b3-ae6f-2da543367a54 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.823508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 219/440] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:32:42.832698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81ff2f-f1d7-4b62-8d22-e6766808be68 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.833171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81ff2f-f1d7-4b62-8d22-e6766808be68 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.833690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81ff2f-f1d7-4b62-8d22-e6766808be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.859067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8d81ff2f-f1d7-4b62-8d22-e6766808be68 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:42.860629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8d81ff2f-f1d7-4b62-8d22-e6766808be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:42.902917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5276-084e-4dff-9dbe-30d280776d54 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:42.952173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:42.953000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:42.953405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:42.955868 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:42.958576 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:42.960250 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:42.962993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 222/441] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:42 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:42.969694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:42.990282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 220/442] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:42.991898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81ff2f-f1d7-4b62-8d22-e6766808be68 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:43.052807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:43.057572 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:43.119145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06466f-68a8-4024-b33a-c8e4aaea2b14 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:43.146135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81ff2f-f1d7-4b62-8d22-e6766808be68 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:43.169922 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:43.170535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:43.170810 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:43.171086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:43.171813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=c5260227d3ff4cbf956c47e3590a0ba1, scope.project.id=6f29f91d86c343dca7b2eab39e67a922) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:43.172117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:43.173558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:43.183458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 223/443] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:42 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=c5260227d3ff4cbf956c47e3590a0ba1 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:43.206663 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:43.207501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:43.207906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:43.208323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:43.222429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:43.227936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:43.230097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:43.230989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 221/444] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:43.236799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:43.291675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:43.381519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8cb06-afc7-4e10-b4df-7cbefc31aa6f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:43.428405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:43.439107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:43.443902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dd611-1d32-49b7-94c5-002828b8a44e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:43.445600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:43.446507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:43.446845 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:43.447169 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:43.447967 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:43.448314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:43.450731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:43.466324 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 224/445] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:43.473441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:43.507028 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:43.507668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:43.507943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:43.508212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:43.525198 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:43.530452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:43.531511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:32:43.532429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:43.534421 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 222/446] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:43.543403 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:43.627714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809eeca-f0a2-4465-91b4-e280601b0c9e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:43.669823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:43.670359 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:43.670644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:43.670965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:43.682599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f44a-b150-40e5-9ba9-45083075adc0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:43.718572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:43.719266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:43.719428 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:43.719702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:43.720377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:43.720751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:43.722179 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:43.731115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 223/447] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:43.731581 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:43.737237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:43.746709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:43.748569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:43.764430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:43.867055 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667093-4e27-4314-8631-61e9188c3fda None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:43.877764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 225/448] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:32:43.883763 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:43.904350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:43.904963 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:43.905242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:43.905514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:43.986821 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:43.990100 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:43.991783 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:44.001341 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c612a3-6860-4af9-a43a-5edf5d0c35e6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:44.019778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:44.042861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:44.043510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:44.043791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:44.044066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] PATH_INFO: `/v3/projects/6f29f91d86c343dca7b2eab39e67a922` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:44.045313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] RBAC: Authorizing `identity:get_project(project_id=6f29f91d86c343dca7b2eab39e67a922)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:44.046883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:44.048681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 226/449] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:43 2022] GET /identity/v3/projects/6f29f91d86c343dca7b2eab39e67a922 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:44.054550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:44.120759 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 224/450] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:32:44.122659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:44.183445 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c8a9-b188-4a3d-918a-a80b5fbe0c31 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:44.225808 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:44.226460 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:44.226726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:44.227038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] PATH_INFO: `/v3/groups/f678851cbe2546a5876e9321e7c0b0f3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:44.229265 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] RBAC: Authorizing `identity:get_group(group_id=f678851cbe2546a5876e9321e7c0b0f3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:44.231214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:44.233434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 227/451] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:44 2022] GET /identity/v3/groups/f678851cbe2546a5876e9321e7c0b0f3 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:44.240066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:44.257044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4f970-ed2f-4771-8b39-43539f2d3c83 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:44.269384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:44.291314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:44.311750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:44.312812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:44.313313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:44.313851 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] PATH_INFO: `/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:44.315877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] RBAC: Authorizing `identity:get_project(project_id=e37cfa01ad9247dab92fb4fc2b4b39f2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:44.318706 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:44.322098 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 225/452] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:32:44 2022] GET /identity/v3/projects/e37cfa01ad9247dab92fb4fc2b4b39f2 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:44.328356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:44.350298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748879-b46d-4445-8114-79c37d36e66e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:44.388938 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:44.389495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:44.389815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:44.390094 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:44.390845 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] RBAC: Adding query filter params (group.id=f678851cbe2546a5876e9321e7c0b0f3, role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=6f29f91d86c343dca7b2eab39e67a922) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:44.391151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:44.392638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:44.399111 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 228/453] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:44 2022] GET /identity/v3/role_assignments?group.id=f678851cbe2546a5876e9321e7c0b0f3&scope.project.id=6f29f91d86c343dca7b2eab39e67a922&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:44.454116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fd11c-2812-4e64-8824-30024cc96a23 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:44.496340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a53c52-c886-4bc5-838d-cce8f800bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:44.496910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53c52-c886-4bc5-838d-cce8f800bd3f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:44.497191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53c52-c886-4bc5-838d-cce8f800bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:44.497468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53c52-c886-4bc5-838d-cce8f800bd3f None admin] PATH_INFO: `/v3/groups/32d26d34633b4bf2a8cb6858ae99bb2c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:44.498786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a53c52-c886-4bc5-838d-cce8f800bd3f None admin] RBAC: Authorizing `identity:get_group(group_id=32d26d34633b4bf2a8cb6858ae99bb2c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:44.500293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a53c52-c886-4bc5-838d-cce8f800bd3f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:44.502087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 226/454] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 22 02:32:44 2022] GET /identity/v3/groups/32d26d34633b4bf2a8cb6858ae99bb2c => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:44.508367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:44.628800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:44.647464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06acf3b-0810-49bd-b814-dbea116c7f34 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:44.686453 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf122-d68c-44c2-9f26-b417c1342c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:44.687085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf122-d68c-44c2-9f26-b417c1342c35 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:44.687367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf122-d68c-44c2-9f26-b417c1342c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:44.687645 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf122-d68c-44c2-9f26-b417c1342c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:44.688400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebf122-d68c-44c2-9f26-b417c1342c35 None admin] RBAC: Adding query filter params (group.id=32d26d34633b4bf2a8cb6858ae99bb2c, role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=e37cfa01ad9247dab92fb4fc2b4b39f2) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:44.688712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebf122-d68c-44c2-9f26-b417c1342c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:44.690207 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebf122-d68c-44c2-9f26-b417c1342c35 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:44.697260 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 229/455] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 22 02:32:44 2022] GET /identity/v3/role_assignments?group.id=32d26d34633b4bf2a8cb6858ae99bb2c&scope.project.id=e37cfa01ad9247dab92fb4fc2b4b39f2&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:47.685778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bede0-a11f-4903-90f9-7e59bb0288ff None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:47.686914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bede0-a11f-4903-90f9-7e59bb0288ff None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:47.687472 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bede0-a11f-4903-90f9-7e59bb0288ff None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:47.689070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 227/456] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:47.698207 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074b446-1752-4433-95a3-dc72fda105ff None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:47.698759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074b446-1752-4433-95a3-dc72fda105ff None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:47.699153 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074b446-1752-4433-95a3-dc72fda105ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:47.746248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e074b446-1752-4433-95a3-dc72fda105ff None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:47.748324 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e074b446-1752-4433-95a3-dc72fda105ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:47.851538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 230/457] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:47.944923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738054f-a920-4a33-aabc-63fd2b5e7fe8 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:47.945419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738054f-a920-4a33-aabc-63fd2b5e7fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:47.946548 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738054f-a920-4a33-aabc-63fd2b5e7fe8 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:47.949289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 228/458] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:47.954823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448cc4-7557-4098-bf1b-0420b7cf680b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:47.955114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448cc4-7557-4098-bf1b-0420b7cf680b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:47.955370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448cc4-7557-4098-bf1b-0420b7cf680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:47.982822 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7a448cc4-7557-4098-bf1b-0420b7cf680b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:47.984036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7a448cc4-7557-4098-bf1b-0420b7cf680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:48.081504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 231/459] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:48.329983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738054f-a920-4a33-aabc-63fd2b5e7fe8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:48.462404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:48.554047 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738054f-a920-4a33-aabc-63fd2b5e7fe8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:48.622390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:48.622967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:48.623251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:48.623532 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:48.646238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:48.648435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:48.675054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:48.676852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:48.678675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:48.678675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:48.678675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:48.678675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 229/460] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:48.689801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448cc4-7557-4098-bf1b-0420b7cf680b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:48.719279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:48.734280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:48.887584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d5c94-2220-460f-ac90-0995c9845fc5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:48.901515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:48.920181 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448cc4-7557-4098-bf1b-0420b7cf680b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:48.930653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e716f7-67eb-4a22-896e-a593c99fa62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:48.931306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e716f7-67eb-4a22-896e-a593c99fa62e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:48.931574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e716f7-67eb-4a22-896e-a593c99fa62e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:48.931845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e716f7-67eb-4a22-896e-a593c99fa62e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:48.944883 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e716f7-67eb-4a22-896e-a593c99fa62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:48.946952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e716f7-67eb-4a22-896e-a593c99fa62e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-98e716f7-67eb-4a22-896e-a593c99fa62e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:48.964584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:48.966360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:48.968030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:48.968030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:48.968030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:48.971195 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 230/461] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:48.972612 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c23cf-8f6e-4e79-b4c7-6027646907b1 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:48.972888 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c23cf-8f6e-4e79-b4c7-6027646907b1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:48.973162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c23cf-8f6e-4e79-b4c7-6027646907b1 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:48.981181 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 231/462] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:48.981181 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c23cf-8f6e-4e79-b4c7-6027646907b1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:49.005770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b46b4a-e8e7-4e46-a905-5576df0795b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:49.007340 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46b4a-e8e7-4e46-a905-5576df0795b0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.008116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46b4a-e8e7-4e46-a905-5576df0795b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.009533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46b4a-e8e7-4e46-a905-5576df0795b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.011221 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46b4a-e8e7-4e46-a905-5576df0795b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:49.012258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46b4a-e8e7-4e46-a905-5576df0795b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:49.015230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46b4a-e8e7-4e46-a905-5576df0795b0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:49.044480 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 232/463] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:49.047704 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67e7c-841e-4fbf-a4d6-6bb8ba093029 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.048504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67e7c-841e-4fbf-a4d6-6bb8ba093029 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.049296 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67e7c-841e-4fbf-a4d6-6bb8ba093029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.085096 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-04a67e7c-841e-4fbf-a4d6-6bb8ba093029 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:49.088130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-04a67e7c-841e-4fbf-a4d6-6bb8ba093029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:49.096476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c23cf-8f6e-4e79-b4c7-6027646907b1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:49.137446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:49.138173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.138435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.138684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.139281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:49.139580 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:49.141263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:49.157011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 232/464] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:49.157644 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:49.192438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:49.238395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 233/465] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:49.240487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a67e7c-841e-4fbf-a4d6-6bb8ba093029 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:49.246117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:49.280101 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb0f7-33e2-49fe-9a0f-23d83413870d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:49.319827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:49.320463 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.320710 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.321074 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.321910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:49.323346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:49.357857 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 233/466] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:32:49 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:49.532473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a67e7c-841e-4fbf-a4d6-6bb8ba093029 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:49.601009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f22e-6f8c-4eb8-9678-8e85d96ade6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:49.601682 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f22e-6f8c-4eb8-9678-8e85d96ade6e None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.601969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f22e-6f8c-4eb8-9678-8e85d96ade6e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.602291 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f22e-6f8c-4eb8-9678-8e85d96ade6e None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.602964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f22e-6f8c-4eb8-9678-8e85d96ade6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:49.610503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f22e-6f8c-4eb8-9678-8e85d96ade6e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:49.646168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 234/467] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:32:49 2022] POST /identity/v3/users => generated 248 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:49.718753 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:49.760002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65d6f6-e37c-4db5-b0b0-92a875e7931c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.761555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65d6f6-e37c-4db5-b0b0-92a875e7931c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.762495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65d6f6-e37c-4db5-b0b0-92a875e7931c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.766030 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 235/468] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:32:49.776638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d0ff0-8368-4262-828c-542d9e0149c6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.777704 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d0ff0-8368-4262-828c-542d9e0149c6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.778610 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d0ff0-8368-4262-828c-542d9e0149c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.815059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c73d0ff0-8368-4262-828c-542d9e0149c6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:49.818212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c73d0ff0-8368-4262-828c-542d9e0149c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:49.821917 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:49.853083 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0d83-9de7-43e4-b6b7-67e4c2530a79 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:49.897711 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:49.898374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:49.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:49.898971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:49.912730 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:49.914239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:49.935504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:49.937240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:49.940878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:49.940878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:49.940878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:49.940878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 234/469] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:49.944440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:49.948109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:49.985726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 236/470] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:50.121408 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a32c-835b-4a74-a05b-6853ed57440c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:50.154603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:50.161553 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:50.162588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:50.163090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:50.163720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:50.164951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:50.165471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:50.167081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:50.181514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 235/471] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:50.189509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d0ff0-8368-4262-828c-542d9e0149c6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:50.267534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:50.320387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d0ff0-8368-4262-828c-542d9e0149c6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:50.367362 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56dd89-6214-48b2-89f1-62d5244118e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:50.368557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56dd89-6214-48b2-89f1-62d5244118e1 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:50.368836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56dd89-6214-48b2-89f1-62d5244118e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:50.369105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56dd89-6214-48b2-89f1-62d5244118e1 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:50.369878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56dd89-6214-48b2-89f1-62d5244118e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:50.371393 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56dd89-6214-48b2-89f1-62d5244118e1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:50.403368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 237/472] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:32:50 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:50.464156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447006d-e1fd-4e17-a913-fe7ab3f51feb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:50.480336 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189568e-cb6c-414a-9af6-5270822a41e0 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:50.480781 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189568e-cb6c-414a-9af6-5270822a41e0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:50.481065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189568e-cb6c-414a-9af6-5270822a41e0 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:50.483081 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 238/473] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:32:50.491770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41252452-228f-486c-9531-30404b8f0e0f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:50.492255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41252452-228f-486c-9531-30404b8f0e0f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:50.492642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41252452-228f-486c-9531-30404b8f0e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:50.514693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:50.515347 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:50.515624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:50.515895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:50.530683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:50.532373 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:50.534895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-41252452-228f-486c-9531-30404b8f0e0f None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:50.536133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-41252452-228f-486c-9531-30404b8f0e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:50.564601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:50.566220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:50.568040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:50.568040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:50.568040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:50.573444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 236/474] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:50.584581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:50.644672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:50.662791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:50.710865 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 239/475] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:50.760572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e971cc-1149-4f99-a9a3-36ba0785644f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:50.804682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:50.805866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:50.806375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:50.806860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:50.807844 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:50.808374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:50.810063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:50.826701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 237/476] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:50.832093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41252452-228f-486c-9531-30404b8f0e0f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:50.959397 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41252452-228f-486c-9531-30404b8f0e0f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:51.000049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:51.001034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:51.001578 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:51.002084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:51.002973 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:51.004674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:51.030544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 240/477] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:32:50 2022] POST /identity/v3/users => generated 249 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:32:51.043754 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:51.176999 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9afb0-bff0-4558-be12-b3d95daccf06 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:51.180681 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:51.223250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:51.224328 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:51.224819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:51.225309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:51.226301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:51.227967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:51.237960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.sql.core [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 02:32:51.237960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 02:32:51.237960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [parameters: {'id': '200455273dac47388899b9260d292653', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 02:32:51.237960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 22 02:32:51.260011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return ref.to_dict() Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 02:32:51.260981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application yield resource Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise self.value Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application session.commit() Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 02:32:51.261994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.flush() Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application compat.raise_( Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 02:32:51.262988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 02:32:51.264809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 02:32:51.265673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [parameters: {'id': '200455273dac47388899b9260d292653', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:51.266477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 02:32:51.268143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:51.272246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 238/478] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 22 02:32:51 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:51.278888 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:51.315663 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:51.402346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d804-f9c6-4419-8959-832f84bc09c6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:51.445303 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3082c-3335-48ec-97af-fea2c9028085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:51.446459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3082c-3335-48ec-97af-fea2c9028085 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:51.446953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3082c-3335-48ec-97af-fea2c9028085 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:51.447443 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3082c-3335-48ec-97af-fea2c9028085 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:51.464754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3082c-3335-48ec-97af-fea2c9028085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e4b3082c-3335-48ec-97af-fea2c9028085 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:51.476258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:51.478657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 02:32:51.481247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:51.483674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 241/479] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:32:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:51.493350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:51.695486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193467c-ac0c-439a-b8a0-92f78d18d00a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:51.741419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647501e-8426-4fdf-8524-ec13b3024b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:51.742311 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647501e-8426-4fdf-8524-ec13b3024b14 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:51.743321 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647501e-8426-4fdf-8524-ec13b3024b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:51.743758 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647501e-8426-4fdf-8524-ec13b3024b14 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:51.744610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647501e-8426-4fdf-8524-ec13b3024b14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:51.745060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647501e-8426-4fdf-8524-ec13b3024b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:51.750830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647501e-8426-4fdf-8524-ec13b3024b14 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:51.761232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 239/480] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:52.324843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a79a-5fee-4e23-99b9-1ae814669658 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:52.325396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a79a-5fee-4e23-99b9-1ae814669658 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:52.325396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a79a-5fee-4e23-99b9-1ae814669658 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:52.327368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 242/481] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:52.332902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377d64-9596-40aa-981c-805ab3aa683e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:52.333907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377d64-9596-40aa-981c-805ab3aa683e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:52.333907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377d64-9596-40aa-981c-805ab3aa683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:52.355677 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9e377d64-9596-40aa-981c-805ab3aa683e None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:52.356908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9e377d64-9596-40aa-981c-805ab3aa683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:52.397881 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:52.479065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 240/482] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:52.670927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0292e-661a-4fa9-bc8f-36cff2e73d66 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:52.671260 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0292e-661a-4fa9-bc8f-36cff2e73d66 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:52.671473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0292e-661a-4fa9-bc8f-36cff2e73d66 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:52.673094 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 243/483] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:52.679002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f02b2-4a07-4081-8873-7d158400d003 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:52.679305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f02b2-4a07-4081-8873-7d158400d003 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:52.679567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f02b2-4a07-4081-8873-7d158400d003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:52.708129 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-630f02b2-4a07-4081-8873-7d158400d003 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:52.709350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-630f02b2-4a07-4081-8873-7d158400d003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:52.812268 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 241/484] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:32:53.053019 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0292e-661a-4fa9-bc8f-36cff2e73d66 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:53.180578 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:53.193402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0292e-661a-4fa9-bc8f-36cff2e73d66 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:53.245579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f02b2-4a07-4081-8873-7d158400d003 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:53.263933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:53.264595 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:53.264871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:53.265148 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:53.295934 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:53.301400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:53.302329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:53.303151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 244/485] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:53.308529 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:53.455225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cab2ad-20b4-4fac-b6a7-053c22ff0f23 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:53.482694 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:53.500090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:53.500958 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:53.501312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:53.501683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:53.502449 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:53.502924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:53.504773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:53.516317 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 245/486] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:32:53.518683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f02b2-4a07-4081-8873-7d158400d003 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:53.522350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:53.552823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:53.636718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:53.637833 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:53.638602 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:53.639117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:53.673138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:53.685214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:53.686191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:53.687033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:53.692195 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 242/487] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:32:53.698302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:53.744792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f1990-41fb-4f3c-ba60-924e18ab5cc9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:53.786154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b19011-8af3-4c86-8582-f780111d0198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:53.787112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b19011-8af3-4c86-8582-f780111d0198 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:53.787535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b19011-8af3-4c86-8582-f780111d0198 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:53.787945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b19011-8af3-4c86-8582-f780111d0198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:53.802843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b19011-8af3-4c86-8582-f780111d0198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:53.805964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b19011-8af3-4c86-8582-f780111d0198 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-97b19011-8af3-4c86-8582-f780111d0198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:53.823315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:53.824283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:53.825113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:53.825113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:53.825113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:53.831672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 246/488] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:53.833510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586d3c1-ff26-424e-aba2-53ef97defef3 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:53.834026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586d3c1-ff26-424e-aba2-53ef97defef3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:53.834477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586d3c1-ff26-424e-aba2-53ef97defef3 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:53.836115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 247/489] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:53.837585 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586d3c1-ff26-424e-aba2-53ef97defef3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:53.862627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ecafa-cd16-4b3a-8e6a-626c339195c2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:53.910164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944ea02-2145-48fa-81f0-e803ff3c9466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:53.911173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944ea02-2145-48fa-81f0-e803ff3c9466 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:53.911698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944ea02-2145-48fa-81f0-e803ff3c9466 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:53.912187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944ea02-2145-48fa-81f0-e803ff3c9466 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:53.913098 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944ea02-2145-48fa-81f0-e803ff3c9466 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:53.913613 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944ea02-2145-48fa-81f0-e803ff3c9466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:53.916029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944ea02-2145-48fa-81f0-e803ff3c9466 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:53.922654 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:53.926752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 243/490] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:53.928417 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a025-f5f5-4cfd-ae75-cfff804b1b18 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:53.928969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a025-f5f5-4cfd-ae75-cfff804b1b18 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:53.929450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a025-f5f5-4cfd-ae75-cfff804b1b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:53.951167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e118a025-f5f5-4cfd-ae75-cfff804b1b18 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:53.952886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e118a025-f5f5-4cfd-ae75-cfff804b1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:53.956550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:53.979589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586d3c1-ff26-424e-aba2-53ef97defef3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.021997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a54d7-a9d0-4745-87c9-a4327a68bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.022613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a54d7-a9d0-4745-87c9-a4327a68bd82 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.022898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a54d7-a9d0-4745-87c9-a4327a68bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.023173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a54d7-a9d0-4745-87c9-a4327a68bd82 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.023886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a54d7-a9d0-4745-87c9-a4327a68bd82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:54.024690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a54d7-a9d0-4745-87c9-a4327a68bd82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.026128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a54d7-a9d0-4745-87c9-a4327a68bd82 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.034081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 244/491] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:54.034081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118a025-f5f5-4cfd-ae75-cfff804b1b18 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.044773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 248/492] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:54.044773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821b60-1949-40ca-b186-cd01fff61f29 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.044773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821b60-1949-40ca-b186-cd01fff61f29 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.044773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821b60-1949-40ca-b186-cd01fff61f29 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.046357 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 249/493] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:54.047042 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821b60-1949-40ca-b186-cd01fff61f29 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.162113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118a025-f5f5-4cfd-ae75-cfff804b1b18 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.165214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821b60-1949-40ca-b186-cd01fff61f29 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.192099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:54.199490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27506cbe-62ea-4aee-86e8-f1fe03396daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.200103 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506cbe-62ea-4aee-86e8-f1fe03396daa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.200386 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506cbe-62ea-4aee-86e8-f1fe03396daa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.200670 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506cbe-62ea-4aee-86e8-f1fe03396daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.208206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.209143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.209957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:54.210198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.210671 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.212256 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27506cbe-62ea-4aee-86e8-f1fe03396daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.214299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27506cbe-62ea-4aee-86e8-f1fe03396daa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.221637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.223462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-27506cbe-62ea-4aee-86e8-f1fe03396daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:54.231771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:54.232814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:54.233775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:54.233775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:54.233775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:54.233775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 245/494] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:54.235321 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08b024-c573-486b-8435-be9c56133dc7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.235712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08b024-c573-486b-8435-be9c56133dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.236085 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08b024-c573-486b-8435-be9c56133dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:32:54.241719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:54.243351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 02:32:54.244224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:54.251466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 250/495] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:54.252610 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.257716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ad08b024-c573-486b-8435-be9c56133dc7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:54.258694 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ad08b024-c573-486b-8435-be9c56133dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:54.330164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 246/496] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:54.331143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08b024-c573-486b-8435-be9c56133dc7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.375545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c1401-cffb-454c-9b51-a7e453063646 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.414414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.415344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.415691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.416041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.416772 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:54.417169 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.418711 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.433257 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 251/497] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:54.434279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.477716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08b024-c573-486b-8435-be9c56133dc7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.494495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:54.516624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:54.531372 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.532364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.532791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.533314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.534243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:54.534698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.536425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.558072 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db225-6e26-47da-a7c4-27197ed90865 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.584741 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 247/498] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:54.585969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.596425 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.597121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.597402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.597714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.609925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:54.615377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:54.616301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:54.617098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 252/499] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:54.622753 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.709869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414de9c-3953-484d-996f-89efb6ffc350 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.738064 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4e5d9-4f98-4256-9330-a5f9a7aa9407 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.741979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:54.752915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.753755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.753901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.754146 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.763094 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.764561 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:32:54.781637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:54.782618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:54.783802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 248/500] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:54.784587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.794796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.795414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.795687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.795954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.833003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:54.872289 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.873828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.899953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da892e5-50ba-43ed-8d11-8c50f04249d3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:54.939822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:54.940434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:54.940720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:54.940994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:54.941683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:54.942007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:54.943401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:54.951968 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 249/501] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:54.952827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.991750 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 253/502] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:54.993064 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:54.996785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.067591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0652fa3-cd2f-4e65-8fd6-1cb44a2bf59b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.070124 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.106875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.107542 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.107821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.108094 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.114063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf029-b00e-4a9e-a8e7-dce1bc9354ae None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.121392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:32:55.126986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:55.127959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:55.128755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 250/503] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:55.130193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:55.162505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.163256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.163778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.164053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.165163 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:55.165471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:55.166984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:55.226261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 254/504] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 22 02:32:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:55.226261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:55.261390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b973c5-beaa-415c-b21a-4b95e48031fe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.301614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.308606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.309587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.309993 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.310418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.324575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:55.326057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:55.341147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:55.343065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:55.345197 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:55.345197 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:55.345197 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:55.345197 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 251/505] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:55.345197 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:55.350105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6decb-6906-45e9-945e-85f7dfadc8b2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.363272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.388742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.389706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.390144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.390415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.401835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:55.403420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:55.419620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:55.421390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:55.423066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:55.423066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:55.423066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:55.423066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 255/506] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:55.423066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:55.464219 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17161-cba1-4231-a80d-0572b0597b3d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.504507 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ad84-2bab-4a8d-adbe-06ef813708e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.505120 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ad84-2bab-4a8d-adbe-06ef813708e7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.505409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ad84-2bab-4a8d-adbe-06ef813708e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.505701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ad84-2bab-4a8d-adbe-06ef813708e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.506363 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ad84-2bab-4a8d-adbe-06ef813708e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:55.506665 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ad84-2bab-4a8d-adbe-06ef813708e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:55.508035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ad84-2bab-4a8d-adbe-06ef813708e7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:55.518741 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 252/507] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:32:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:55.519957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9bce8-2b72-4597-9f0c-3cff886cec5f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.520243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9bce8-2b72-4597-9f0c-3cff886cec5f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.520511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9bce8-2b72-4597-9f0c-3cff886cec5f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.521887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 253/508] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:32:55.522667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9bce8-2b72-4597-9f0c-3cff886cec5f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:55.550244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62e0a5-bbb6-4ff4-9ad4-22af3648d6a2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.568093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.596642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.597462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.597844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.598158 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.619801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.646212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9bce8-2b72-4597-9f0c-3cff886cec5f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.695238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.696741 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.697199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.697635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.698630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:55.698769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:55.699180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:55.701121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:55.701357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:55.720634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 254/509] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:55.721967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:55.843238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 256/510] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:55.844613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:55.858675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f3bc-09dc-44af-ab7f-abae8b0e6378 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:55.863167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.900326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123328-576c-431a-be0d-751f6925268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:55.901168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123328-576c-431a-be0d-751f6925268d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.901623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123328-576c-431a-be0d-751f6925268d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.902118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123328-576c-431a-be0d-751f6925268d None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.903145 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02123328-576c-431a-be0d-751f6925268d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:55.903648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02123328-576c-431a-be0d-751f6925268d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:55.906042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02123328-576c-431a-be0d-751f6925268d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:55.909921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:55.923477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 255/511] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:55.924932 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a689619-8ca3-4f2b-a830-e51c5e427782 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:55.925328 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a689619-8ca3-4f2b-a830-e51c5e427782 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:55.925793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a689619-8ca3-4f2b-a830-e51c5e427782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:55.951139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4a689619-8ca3-4f2b-a830-e51c5e427782 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:32:55.952922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4a689619-8ca3-4f2b-a830-e51c5e427782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:32:55.989538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd60b53-f2da-4707-8cb0-999b733733bf None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.034696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.035498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.035869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.036294 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.043418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 256/512] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:32:56.044451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a689619-8ca3-4f2b-a830-e51c5e427782 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.061599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.064458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:56.090897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:56.092648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:56.095179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:56.095179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:56.095179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:56.095179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 257/513] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:56.095179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.193956 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:56.224263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a689619-8ca3-4f2b-a830-e51c5e427782 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.240891 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52644-cdcd-469c-90ff-74e16d9c8fb1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.276696 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:56.286861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.287772 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.288441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.288851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.290356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.291291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.291717 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.292116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.301245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.303606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.309551 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.312564 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:32:56.318971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:56.319956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:32:56.321440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:56.321970 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 257/514] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:56.323184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:56.343965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:56.345945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:56.352479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:56.352479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:56.352479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:56.352479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 258/515] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:56.352479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.462805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853772b-d514-4b4c-8038-9b926b6145a1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.469792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573c170-d8cf-4a70-9f90-ab9371e0f67e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.488995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:56.513999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.514916 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.515367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.515814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.516946 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:56.517458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.519980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.523153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.524671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.525133 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.525581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.536610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.539109 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.540988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 259/516] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:56.542176 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:32:56.560031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:56.561579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:56.563504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 258/517] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:56.564592 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.642519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:56.685209 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb55aa-fa36-483a-98bc-aae872efc7db None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.715436 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b6b5b-3299-40ae-a968-3092d55d80a6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.722872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.723651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.724038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.724420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.736756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.738278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:56.760995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:56.763061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:56.765161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:56.765161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:56.765161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:56.769364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 260/518] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:56.770228 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.773503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.774530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.774946 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.775356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.776557 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:56.777035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.779471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.802364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 259/519] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:56.803235 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:56.812804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:56.918857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ccf0-62d7-4cb9-aca5-fbaa82c4e866 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.941354 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d280e7-0ec0-4198-ba44-695f6d510bf5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:56.944246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:56.971152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.971949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.972299 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.972642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.973476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:56.973972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:56.975729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:56.989028 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:56.989831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:56.990183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:56.990526 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:56.991356 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 261/520] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:56.992010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.007247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.010444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:32:57.031377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:57.033369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 260/521] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:57.035156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.130224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:57.143057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2214-c687-4c53-9df2-559b832f68ac None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:57.184905 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:57.185676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:57.186054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:57.186411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:57.187214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:57.187394 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb39c4-608a-4920-b08d-d1b08c414061 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:57.187686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.189245 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.208499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 262/522] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:57.210075 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.244343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:57.245396 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:57.245946 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:57.246439 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:57.247651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:57.248244 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.251063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.267237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 261/523] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:57.268113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.300338 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:57.346170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117294-aa75-44f3-82d6-9ab147dc0286 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:57.384998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:57.385612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:57.385922 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:57.386196 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:57.408854 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:57.420474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b336fb7-0967-4095-9784-b7203e3941de None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:57.474852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:57.475555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:57.476004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:57.476441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:57.485676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.487439 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.488449 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.489941 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:32:57.510585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:57.514126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:57.516116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 262/524] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:57.517245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.621534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:57.638156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b229ba-6e98-46ce-a109-314715788403 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:57.661563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 263/525] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:57.663498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.692510 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:57.693465 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:57.694048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:57.694496 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:57.696307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:57.696808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.699341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.723523 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 263/526] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Sep 22 02:32:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:57.725214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.738347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:57.821392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc616edd-45a9-43b9-93d0-d14f2046e425 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:57.847869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01038-e4fd-414f-968c-e4ca8d136d42 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:57.865240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:57.866227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:57.866680 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:57.867127 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:57.868904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=78a88b5980e5458198ad510ff8bf2994) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:57.869407 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.871978 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.880792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 264/527] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:57 2022] GET /identity/v3/role_assignments?user.id=78a88b5980e5458198ad510ff8bf2994&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:57.882033 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:57.910768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:57.912025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:57.912527 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:57.913033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:57.914906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:57.917958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:57.944173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:57.953080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 264/528] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:32:57 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:32:57.954691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:58.088593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cd91e-3742-4fc3-a64f-60f2e2a4c812 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:58.110856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:58.116460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e2e-4b76-4a9e-add0-2f6fae147238 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:58.152864 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:58.153981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:58.154466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:58.155043 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:58.156494 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:58.157009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:58.159866 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:58.167258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:58.168785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:58.169504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:58.170234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:58.188460 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 265/529] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:32:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:58.190415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:58.200060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:58.202938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:58.232708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:58.234518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:58.236847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:58.236847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:58.236847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:58.236847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 265/530] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:58.236847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:58.349807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:58.370705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee347ad-c6ca-43ad-abfc-ecaee7239e1e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:58.413320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b1e1-977f-4453-92f0-13fd25584d89 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:58.439053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:58.440093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:58.440580 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:58.441058 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:58.455503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:58.456135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:58.456401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:58.456687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:58.457611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=a5cf3b19d04044fda6a4aa1b5d7aff2c) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:58.457967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:58.459471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:58.467924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 266/531] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:58 2022] GET /identity/v3/role_assignments?user.id=a5cf3b19d04044fda6a4aa1b5d7aff2c&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:58.468576 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:58.580368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:58.621467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63852dad-ce43-46cf-a783-79558845b482 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:58.640574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:58.684917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:58.686974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:58.696700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:58.697828 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:58.698301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:58.698793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:58.700173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:58.700709 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:58.709824 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:58.753378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 267/532] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:58.763369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:58.889046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 266/533] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:32:58.895335 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:59.059439 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:59.112743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd228da-af60-404d-aa33-6f5a867a50aa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:59.118539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f1fb-6d61-496d-a452-beae19373298 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:59.232163 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:59.233239 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:59.233735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:59.234219 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:59.238140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:59.239821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:59.240414 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:59.240893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:59.272550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:59.275863 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:59.280440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:59.283250 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:32:59.317339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:59.319042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:32:59.321214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:32:59.326053 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 268/534] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 559 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:59.331497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:32:59.335458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:32:59.339313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:32:59.342673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:32:59.342673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:32:59.342673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:32:59.342673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 267/535] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:32:59.343587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:59.420829 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:59.576137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ed1de-1d77-4ca0-93ef-050e7906db9e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:59.654031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:32:59.692514 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:59.693537 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:59.694024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:59.694477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:59.701928 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:59.702313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:59.703815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:59.709193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd95357-66a3-42f0-a091-941ca4ca93e9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:32:59.745063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 268/536] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:59.754168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:32:59.801769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:32:59.802805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:32:59.803299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:32:59.803801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:32:59.805675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:32:59.806226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:32:59.817502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:32:59.857771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 269/537] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:32:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:32:59.864700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:00.002354 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b17f-2fb3-4edc-a1a7-f35cee62e43f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:00.062200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:00.062863 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:00.063157 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:00.063434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:00.079912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:00.081446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:00.084949 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:00.102296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8322ae-14ba-416e-ac9e-b1c17702bb54 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:00.112018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:00.112900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:00.113780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:00.121114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 269/538] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:32:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:00.123381 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:00.198071 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:00.220492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:00.221126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:00.221401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:00.221695 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:00.222459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=94bfeac1fea64803913036131d3bc6f5) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:00.222764 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:00.224218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:00.246322 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 270/539] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:32:59 2022] GET /identity/v3/role_assignments?user.id=94bfeac1fea64803913036131d3bc6f5&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 259 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:00.272487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d9c8-6306-4a55-b929-e6568709c185 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:00.330272 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae238e1-2d22-4a24-a1cf-2d611a5d4890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:00.330982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae238e1-2d22-4a24-a1cf-2d611a5d4890 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:00.331269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae238e1-2d22-4a24-a1cf-2d611a5d4890 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:00.331537 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae238e1-2d22-4a24-a1cf-2d611a5d4890 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:00.332249 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae238e1-2d22-4a24-a1cf-2d611a5d4890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:00.332556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae238e1-2d22-4a24-a1cf-2d611a5d4890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:00.334032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae238e1-2d22-4a24-a1cf-2d611a5d4890 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:00.349183 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 270/540] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:00.358879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:00.509627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001763ef-0308-479b-bb5b-09eca3970403 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:00.557040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf5c05-7516-4e6c-8363-ed80a92ccf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:00.557698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5c05-7516-4e6c-8363-ed80a92ccf83 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:00.558052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5c05-7516-4e6c-8363-ed80a92ccf83 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:00.558333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5c05-7516-4e6c-8363-ed80a92ccf83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:00.559096 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf5c05-7516-4e6c-8363-ed80a92ccf83 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=5cb868fc365140a39e3f64166df3e1ba) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:00.559407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf5c05-7516-4e6c-8363-ed80a92ccf83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:00.560898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf5c05-7516-4e6c-8363-ed80a92ccf83 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:00.570902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 271/541] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:00 2022] GET /identity/v3/role_assignments?user.id=5cb868fc365140a39e3f64166df3e1ba&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:01.327311 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019da78-cde0-45f2-a514-28a13036252c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:01.327843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019da78-cde0-45f2-a514-28a13036252c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:01.328243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019da78-cde0-45f2-a514-28a13036252c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:01.331317 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 271/542] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:01.338387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ec5f-0067-4de8-9559-cf44fb1b10e9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:01.339985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ec5f-0067-4de8-9559-cf44fb1b10e9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:01.340768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ec5f-0067-4de8-9559-cf44fb1b10e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:01.382212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8483ec5f-0067-4de8-9559-cf44fb1b10e9 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:01.384759 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8483ec5f-0067-4de8-9559-cf44fb1b10e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:01.428629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:01.453135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f287-752d-488f-8cac-7f3da978b521 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:01.454710 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f287-752d-488f-8cac-7f3da978b521 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:01.455478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f287-752d-488f-8cac-7f3da978b521 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:01.463031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 272/543] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:33:01.470774 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebe5f3-c554-4952-b9db-c8cc6bc7ee68 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:01.471708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebe5f3-c554-4952-b9db-c8cc6bc7ee68 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:01.472491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebe5f3-c554-4952-b9db-c8cc6bc7ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:01.521240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8aebe5f3-c554-4952-b9db-c8cc6bc7ee68 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:01.522479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8aebe5f3-c554-4952-b9db-c8cc6bc7ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:01.560174 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 272/544] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:01.652714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 273/545] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:01.839702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c46abb-e4e2-4c67-b9fe-2591861af059 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:01.840261 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c46abb-e4e2-4c67-b9fe-2591861af059 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:01.840749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c46abb-e4e2-4c67-b9fe-2591861af059 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:01.843755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 273/546] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:33:01.850316 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583683-86e0-4def-a633-4962b7ebaf85 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:01.850796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583683-86e0-4def-a633-4962b7ebaf85 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:01.851281 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583683-86e0-4def-a633-4962b7ebaf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:01.898428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6c583683-86e0-4def-a633-4962b7ebaf85 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:01.900366 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6c583683-86e0-4def-a633-4962b7ebaf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:01.979727 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:02.073691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 274/547] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:02.137747 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c46abb-e4e2-4c67-b9fe-2591861af059 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:02.167379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c583683-86e0-4def-a633-4962b7ebaf85 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:02.432070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c46abb-e4e2-4c67-b9fe-2591861af059 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:02.456642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c583683-86e0-4def-a633-4962b7ebaf85 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:02.514665 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:02.516173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:02.516943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:02.517714 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:02.538620 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:02.549875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:02.551565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:02.553002 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:02.558245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 274/548] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:02.578755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:02.608466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:02.609841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:02.610992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:02.611535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:02.625542 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:02.649709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:02.656459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:02.658255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:02.659712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:02.665803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 275/549] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:02.668436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:02.728806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:02.798755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216119a-3e76-43d0-aa87-67c955e3d209 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:02.846454 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:02.847196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:02.847518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:02.847785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:02.848411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:02.848777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:02.850455 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:02.865969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 275/550] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:02.865969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:02.886423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7721a1-b634-4682-b5bf-167c01b81b20 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:02.951597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:02.953095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:02.953908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:02.954691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:02.956205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:02.957034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:02.960028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:02.965307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:02.977872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 276/551] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:02.980085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:02.988977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdefde-f9b4-4b02-ba32-85f6c1abb63e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.032243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.032894 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.033169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.033437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.048547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:03.056716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:03.063919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 276/552] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:03.065493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:03.169703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:03.197444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b20eae-b670-4745-b1f5-4ed6ce286bcd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.199529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68f02d-b932-4f73-a7d7-7e59aef984b0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.243207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.243751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.244033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.244308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.247042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:03.259627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:03.261644 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:03.269320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.270765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.271515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.272104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:03.281007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:03.282277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:03.283142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:03.283142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:03.283142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:03.285070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 277/553] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:03.286380 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:03.300599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:03.303635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:03.334137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:03.335125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:03.335964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:03.335964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:03.335964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:03.345012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 277/554] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:03.346808 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:03.417697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d6d3-3087-4cfe-a787-5904f7528399 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.465607 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.466438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.466860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.467138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.467830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:03.468171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:03.469965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:03.481495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 278/555] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:03.482404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:03.548939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a29f9-ce42-4efc-9ad6-8648358b2d05 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.551892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:03.600579 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.600954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.601203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.601471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.602240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:03.602571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:03.604209 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:03.616243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:03.621617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 278/556] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:03.626424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:03.629011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a81f00-dc2b-45fa-857b-d29218fa6303 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.673528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd6709-cd7c-4433-b0de-a8088eff30fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.674173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6709-cd7c-4433-b0de-a8088eff30fa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.674451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6709-cd7c-4433-b0de-a8088eff30fa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.674727 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6709-cd7c-4433-b0de-a8088eff30fa None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.675689 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6709-cd7c-4433-b0de-a8088eff30fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:03.675689 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6709-cd7c-4433-b0de-a8088eff30fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:03.677032 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6709-cd7c-4433-b0de-a8088eff30fa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:03.693554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 279/557] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:03.696237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ff397-e44c-436a-9b86-d518d0240000 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.696726 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ff397-e44c-436a-9b86-d518d0240000 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.697209 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ff397-e44c-436a-9b86-d518d0240000 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.701813 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 280/558] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:03.701813 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ff397-e44c-436a-9b86-d518d0240000 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:03.764768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b797c3-a8c3-46d6-bd6f-8b57642083af None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.808844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.810443 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.811189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.811666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.825120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:03.827602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:03.839269 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ff397-e44c-436a-9b86-d518d0240000 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:03.855163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:03.855463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:03.856347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:03.862391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:03.862391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:03.862391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:03.862391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 279/559] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:03.862391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:03.890821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8da167-f6a7-45b6-9232-78ba9888590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:03.891609 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8da167-f6a7-45b6-9232-78ba9888590f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.891886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8da167-f6a7-45b6-9232-78ba9888590f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.892161 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8da167-f6a7-45b6-9232-78ba9888590f None admin] PATH_INFO: `/v3/users/swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.901848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8da167-f6a7-45b6-9232-78ba9888590f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:03.903629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8da167-f6a7-45b6-9232-78ba9888590f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8d8da167-f6a7-45b6-9232-78ba9888590f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:03.918273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:03.919383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:03.920411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:03.924410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 281/560] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:03.925699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1a67-3c8d-4367-bd82-6976a9575a1c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:03.925995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1a67-3c8d-4367-bd82-6976a9575a1c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:03.926272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1a67-3c8d-4367-bd82-6976a9575a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:03.946585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e85b1a67-3c8d-4367-bd82-6976a9575a1c None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:03.947877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e85b1a67-3c8d-4367-bd82-6976a9575a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:03.949513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:04.016177 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2f3a3-5f63-4ec4-9e4f-41a902db1a85 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.036659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 282/561] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:04.038516 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b1a67-3c8d-4367-bd82-6976a9575a1c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.068166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.069126 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.069617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.070135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.080756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:04.082253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:04.094759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:04.100877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 280/562] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:04.102787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.174212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:04.179282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b1a67-3c8d-4367-bd82-6976a9575a1c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.225211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb354b-6f53-4f8a-8f16-cb8ad7cbf6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.225875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb354b-6f53-4f8a-8f16-cb8ad7cbf6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.226156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb354b-6f53-4f8a-8f16-cb8ad7cbf6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.226428 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb354b-6f53-4f8a-8f16-cb8ad7cbf6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.227155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb354b-6f53-4f8a-8f16-cb8ad7cbf6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:04.227460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb354b-6f53-4f8a-8f16-cb8ad7cbf6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:04.228872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb354b-6f53-4f8a-8f16-cb8ad7cbf6f3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:04.243393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 283/563] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:04.244772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e7fa-90b1-460f-a875-cd3936de94f3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.245057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e7fa-90b1-460f-a875-cd3936de94f3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.245342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e7fa-90b1-460f-a875-cd3936de94f3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.246656 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb2471-a5e5-445e-b664-813c6fcce2a1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.246929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 284/564] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:04.247698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e7fa-90b1-460f-a875-cd3936de94f3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.267977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:04.302931 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.304146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.304601 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.305256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.306770 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:04.307466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:04.310191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:04.344627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 281/565] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:04.346215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.372892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e7fa-90b1-460f-a875-cd3936de94f3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.420833 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0091-4af4-4813-ae7e-081a5a18a6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.422058 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0091-4af4-4813-ae7e-081a5a18a6f2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.422554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0091-4af4-4813-ae7e-081a5a18a6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.423047 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0091-4af4-4813-ae7e-081a5a18a6f2 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.424345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0091-4af4-4813-ae7e-081a5a18a6f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:04.424900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0091-4af4-4813-ae7e-081a5a18a6f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:04.427500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0091-4af4-4813-ae7e-081a5a18a6f2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:04.465964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 285/566] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:04.465964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698cbab-b623-4553-b400-5a6fd350dd2b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.465964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698cbab-b623-4553-b400-5a6fd350dd2b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.465964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698cbab-b623-4553-b400-5a6fd350dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.466795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4b50d-e033-4656-a39f-e2ee6f367c4e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.483522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e698cbab-b623-4553-b400-5a6fd350dd2b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:04.484742 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e698cbab-b623-4553-b400-5a6fd350dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:04.499104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:04.503186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.503862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.504137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.504403 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.512589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:04.514076 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:04.526799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:04.527883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:04.528829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 282/567] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:04.529412 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.564324 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:04.589693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 286/568] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:04.589693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698cbab-b623-4553-b400-5a6fd350dd2b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.660886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4451-3652-47f9-9245-dcc2ee8fef54 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.713318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698cbab-b623-4553-b400-5a6fd350dd2b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.714814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.715768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.716048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.717359 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.729477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:04.736392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:04.737384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:04.738562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:04.742716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 283/569] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:04.743638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.769233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.771026 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.771026 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.771026 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.791565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:04.860999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:04.873568 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8b3d-86e2-42b2-92f1-e08db30401cd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:04.874025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:04.875543 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:04.913305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:04.914947 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:04.915426 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:04.915904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:04.928644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:04.930167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:04.944960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:04.946089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:04.946989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:04.946989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:04.946989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:04.946989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 284/570] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:04.946989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:04.988558 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 287/571] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:33:04.989431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.043040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:05.069423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e262f2-3f9c-421f-a8c2-138c3179755b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.109004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f6e3-d63f-4c11-9286-4ab51672d98e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.115942 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.116558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.116558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.116558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.117894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:05.118202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.119656 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.134935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:05.139012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 285/572] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:05.139952 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.147111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.147735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.148017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.148291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.149494 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:05.149830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.151220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.159732 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 288/573] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:05.160578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.276015 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa15c-8094-432a-8869-4a1189531205 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.286242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8783f6-0af5-44bc-9d5d-d652d82f0ad3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.296094 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:05.315000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.315637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.315918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.316191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.327505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:05.331486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866060-0161-4148-8766-6a459496c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.332090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866060-0161-4148-8766-6a459496c883 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.332396 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866060-0161-4148-8766-6a459496c883 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:05.332735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:05.334211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:05.335499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:05.336936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866060-0161-4148-8766-6a459496c883 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.336936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9866060-0161-4148-8766-6a459496c883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:05.336936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9866060-0161-4148-8766-6a459496c883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.337127 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 286/574] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:05.337127 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.337330 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9866060-0161-4148-8766-6a459496c883 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.350826 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 289/575] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:05.351827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866060-0161-4148-8766-6a459496c883 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.408765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:05.457513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0736a5-e5d1-4a27-b0ca-1392f18074c9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.467505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866060-0161-4148-8766-6a459496c883 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.496697 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.497325 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.497598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.497893 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.502930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.503569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.503847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.504120 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.509221 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.511359 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.516350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.517826 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:05.531269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:05.532415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:05.533538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:05.533538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:05.533538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:05.533538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 287/576] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:05.534357 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:05.539511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:05.541117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:05.542172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:05.542172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:05.542172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:05.542172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 290/577] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:05.542692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.568819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:05.663109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b8ea-4f6a-482d-980f-0d79da90ebd4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.673874 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f148d6-7e5a-4f37-820a-188fba65c03f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.677535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:05.701912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.702538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.702819 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.703081 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.712159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.712763 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.713060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.713302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.714010 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:05.714312 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.715016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.715672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.716458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.723878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 291/578] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:05.724785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:05.737587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:05.738627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:05.739546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:05.739546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:05.739546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:05.739546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 288/579] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:05.739546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.821065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:05.841211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb054-8359-4c81-9028-dd51c78bd282 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.864161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e232-df0d-4527-9a0f-b0c7a9d4ec9f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:05.883636 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.884305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.884585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.884861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.892024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.893755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:05.905029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:05.906080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 292/580] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:05.906957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.914533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:05.915347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:05.915633 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:05.915911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:05.916572 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:05.916877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:05.918342 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:05.931791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 289/581] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:05.932688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:05.964134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:06.042583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950946c0-fb50-4467-afa2-e9104de1516b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.083400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294eda4-ad9d-4b20-808d-54d40640fa5f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.085144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.085821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.086166 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.086434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.087115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:06.087418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.088886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.103878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 293/582] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:06.104798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.108360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:06.148508 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.149571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.150108 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.150588 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.171219 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.173984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:06.193448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:06.195882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:06.197642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:06.197642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:06.197642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:06.197642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 290/583] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:06.197642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.239843 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a35d7c-a0cd-40c2-9406-b9c11f80e8c2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.288104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:06.296948 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.297574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.297883 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.298159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.298817 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:06.299122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.300584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.320970 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 294/584] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:06.320970 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.323200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c336-7e04-489c-8e3d-5015793fe48d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.360662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.361279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.361560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.361863 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.362565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:06.362875 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.364350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.377886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 291/585] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:06.379070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.405322 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:06.449742 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a023-e529-495c-8892-2d3631879fa4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.498684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.499716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.499716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.500033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.510590 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.513034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.520443 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2152-90b6-4558-a820-3188b70fe516 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:06.532464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:06.533549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:06.534490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 295/586] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:06.535614 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.568855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.569499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.569816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.570087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.574154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:06.583477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.585389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:06.605399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:06.606766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:06.608143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 292/587] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:06.609094 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.678975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133804f3-1b8f-4e3d-88df-922af232dd4f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.704357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:06.719379 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.720157 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.720530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.720914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.721680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:06.722060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.724154 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.740065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 296/588] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:06.741210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.767137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c51a3-535c-4bd2-ab53-f5e1d3631633 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.813418 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.814262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.814624 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.814969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.825668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.827811 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:06.847666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:06.848775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:06.850739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 293/589] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:06.851942 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.888296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12218-42b8-4096-9eaa-2916de847502 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:06.932201 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:06.937528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:06.938614 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:06.938991 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:06.939436 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/a5cf3b19d04044fda6a4aa1b5d7aff2c/roles/04e96ff01f0a484ba43803759e6eabe9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:06.958046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=a5cf3b19d04044fda6a4aa1b5d7aff2c, role_id=04e96ff01f0a484ba43803759e6eabe9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:06.959914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:06.977668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 297/590] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:06 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/a5cf3b19d04044fda6a4aa1b5d7aff2c/roles/04e96ff01f0a484ba43803759e6eabe9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:33:06.979186 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:06.997940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7704859-3c50-4d64-ac3b-389e72884d8a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:07.038965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:07.050479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:07.051593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:07.052097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:07.052631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:07.053614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:07.054376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:07.056145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:07.073912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 294/591] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:07.075903 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:07.179063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3c61-1214-46c6-8ca1-2056c7aaf800 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:07.243163 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e200d-4955-4694-9bf6-969ee7dd7091 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:07.249803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:07.250866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:07.251361 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:07.252660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:07.254562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:07.255120 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:07.258389 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:07.262657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:07.285539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 298/592] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:07.285539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:07.290862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:07.291648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:07.292026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:07.292462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:07.301328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:07.303141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:07.317447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:07.318695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:07.319829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:07.326600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 295/593] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:33:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:07.326600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:07.418878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:07.434475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371eaf1-b75f-41c2-afff-45e6d1c6012f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:07.483493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721dfa-0d09-4a01-9398-151c8396165e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:07.488452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:07.489421 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:07.489919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:07.490382 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:07.491638 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:07.492138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:07.495476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:07.529044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 299/594] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Sep 22 02:33:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:07.529044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:07.546404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:07.547097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:07.547553 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:07.548001 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:07.549242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=04490cc2eef14514bc2834de17458744) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:07.549785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:07.552256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:07.570399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 296/595] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:07 2022] GET /identity/v3/role_assignments?user.id=04490cc2eef14514bc2834de17458744&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:07.570399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:07.676107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:07.763899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb33e6-2350-4f06-83da-86f511c03803 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:07.799907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51d07-0f54-4d03-86e1-39f12288f6d2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:07.833158 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:07.835083 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:07.835912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:07.836685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/78a88b5980e5458198ad510ff8bf2994/roles/04e96ff01f0a484ba43803759e6eabe9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:07.865472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:07.866736 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:07.867929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:07.868401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:07.869851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:07.870385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:07.871288 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=78a88b5980e5458198ad510ff8bf2994, role_id=04e96ff01f0a484ba43803759e6eabe9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:07.873215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:07.874770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:07.891666 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:07.903673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 300/596] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:07 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/78a88b5980e5458198ad510ff8bf2994/roles/04e96ff01f0a484ba43803759e6eabe9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:33:07.905808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:07.926928 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 297/597] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:33:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:07.941732 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:08.124600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:08.132243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048f38e-9581-4dd0-a95d-b17d5a13de07 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:08.132923 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c745-01db-4a5c-96f2-5887b5c75b60 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:08.200210 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:08.201182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:08.201608 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:08.202077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:08.222759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:08.225314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:08.229167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:08.230787 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:08.231631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:08.232410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:08.253137 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:08.256669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:08.262833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:08.264773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:08.266694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:08.266694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:08.266694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:08.266694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 298/598] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:08.275068 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:08.295536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:08.297370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:08.299167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:08.299167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:08.299167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:08.302910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 301/599] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:08.308980 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:08.411230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:08.481294 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676fe78-5a03-4baa-843c-6f9fb1e7e09b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:08.504636 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233b15-b87b-4872-83db-84a59e8bb745 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:08.547135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:08.548090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:08.548513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:08.548954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:08.550387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:08.550929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:08.553640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:08.577802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 299/600] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:08.581088 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:08.582189 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:08.582674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:08.583096 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:08.584294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:08.584841 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:08.585235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:08.587519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:08.612004 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:08.612292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 302/601] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:08.633839 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:08.806464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694adbc-ce94-475d-8b3c-4c22a0f388a8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:08.880759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:08.881898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:08.882350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:08.882829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:08.896425 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:08.899800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:08.924095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:08.925597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:08.927252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 300/602] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:08.938337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:09.017547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357e3d-70aa-4618-8823-a85647ebfd09 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:09.066550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:09.087690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:09.139960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:09.140620 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:09.140900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:09.141169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:09.153034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e481bb5-edf3-453f-b11c-60dd359d653d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:09.158870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:09.160349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:09.179057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:09.180707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:09.182450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:09.185866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 303/603] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 561 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:09.198724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:09.224876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:09.225935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:09.226409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:09.227433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:09.229189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:09.229765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:09.237161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:09.288404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 301/604] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:09.298112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:09.500408 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab43ce2-50cf-419d-a3a0-7c27d5e1d478 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:09.505751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bdf35-7aab-4b1e-b0db-42b6b4cd6ccd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:09.550256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:09.559371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:09.560106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:09.560398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:09.560650 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/94bfeac1fea64803913036131d3bc6f5/roles/04e96ff01f0a484ba43803759e6eabe9` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:09.585706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=94bfeac1fea64803913036131d3bc6f5, role_id=04e96ff01f0a484ba43803759e6eabe9)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:09.585706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:09.606089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 302/605] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:09 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/94bfeac1fea64803913036131d3bc6f5/roles/04e96ff01f0a484ba43803759e6eabe9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:33:09.610503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82edb4-18ba-4181-83ba-ccb5881c978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:09.611219 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82edb4-18ba-4181-83ba-ccb5881c978b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:09.611508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82edb4-18ba-4181-83ba-ccb5881c978b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:09.611750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82edb4-18ba-4181-83ba-ccb5881c978b None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:09.612541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82edb4-18ba-4181-83ba-ccb5881c978b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:09.612857 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82edb4-18ba-4181-83ba-ccb5881c978b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:09.614714 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82edb4-18ba-4181-83ba-ccb5881c978b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:09.632571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 304/606] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:09.641409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:09.779547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a3975-d24b-46d9-9307-0e58cd2380fc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:09.823353 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d78014-ae4b-4bf6-b55f-e9555c9c6bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:09.824772 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d78014-ae4b-4bf6-b55f-e9555c9c6bc9 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:09.825208 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d78014-ae4b-4bf6-b55f-e9555c9c6bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:09.825637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d78014-ae4b-4bf6-b55f-e9555c9c6bc9 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/5cb868fc365140a39e3f64166df3e1ba/roles/04e96ff01f0a484ba43803759e6eabe9` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:09.843906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d78014-ae4b-4bf6-b55f-e9555c9c6bc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=5cb868fc365140a39e3f64166df3e1ba, role_id=04e96ff01f0a484ba43803759e6eabe9)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:09.845769 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d78014-ae4b-4bf6-b55f-e9555c9c6bc9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:09.862704 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 303/607] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:09 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/5cb868fc365140a39e3f64166df3e1ba/roles/04e96ff01f0a484ba43803759e6eabe9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:33:10.389375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe6eaf-d052-46a6-9555-e02efeb99fb2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:10.390074 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe6eaf-d052-46a6-9555-e02efeb99fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:10.390551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe6eaf-d052-46a6-9555-e02efeb99fb2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:10.392495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 305/608] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:10.400587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f0c8-8d45-4295-8808-ac7222ab8720 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:10.401101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f0c8-8d45-4295-8808-ac7222ab8720 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:10.401526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f0c8-8d45-4295-8808-ac7222ab8720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:10.430310 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-66d1f0c8-8d45-4295-8808-ac7222ab8720 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:10.431787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-66d1f0c8-8d45-4295-8808-ac7222ab8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:10.463640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:10.534278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 304/609] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:33:11.123149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe6eaf-d052-46a6-9555-e02efeb99fb2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:11.175915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:11.274352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe6eaf-d052-46a6-9555-e02efeb99fb2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:11.331537 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e980da-b3cc-4e5f-97bb-da022b1162d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:11.332193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e980da-b3cc-4e5f-97bb-da022b1162d6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:11.332528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e980da-b3cc-4e5f-97bb-da022b1162d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:11.332808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e980da-b3cc-4e5f-97bb-da022b1162d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:11.350716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e980da-b3cc-4e5f-97bb-da022b1162d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f0e980da-b3cc-4e5f-97bb-da022b1162d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:11.356023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:11.357937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:11.359616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 306/610] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:11.371550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1f0c8-8d45-4295-8808-ac7222ab8720 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:11.561430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1f0c8-8d45-4295-8808-ac7222ab8720 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:11.615644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:11.616568 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:11.617543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:11.618042 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:11.618898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:11.619366 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:11.620933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:11.629705 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f4155-5f84-4b4d-ad29-73a949da15ad None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:11.629705 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f4155-5f84-4b4d-ad29-73a949da15ad None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:11.629705 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f4155-5f84-4b4d-ad29-73a949da15ad None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:11.632735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 307/611] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:11.639969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 305/612] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:11.641698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56716f9-4613-4824-89c6-1056a4544117 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:11.641992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56716f9-4613-4824-89c6-1056a4544117 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:11.642270 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56716f9-4613-4824-89c6-1056a4544117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:11.648446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:11.676722 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f56716f9-4613-4824-89c6-1056a4544117 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:11.678097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f56716f9-4613-4824-89c6-1056a4544117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:11.706535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:11.823258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 308/613] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:11.860168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9b059-7742-41ba-9ae6-d12ab861c457 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:11.905090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:11.905767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:11.906032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:11.906311 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:11.919417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:11.920907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:11.950430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:11.953798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:11.957107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:11.957107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:11.957107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:11.957107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 306/614] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:11.961692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56716f9-4613-4824-89c6-1056a4544117 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:11.993466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:12.083800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56716f9-4613-4824-89c6-1056a4544117 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:12.154106 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527d4f8-c0ea-4132-ba97-89e41604fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:12.155239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527d4f8-c0ea-4132-ba97-89e41604fb6a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:12.155715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527d4f8-c0ea-4132-ba97-89e41604fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:12.156213 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527d4f8-c0ea-4132-ba97-89e41604fb6a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:12.157404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527d4f8-c0ea-4132-ba97-89e41604fb6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:12.157984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527d4f8-c0ea-4132-ba97-89e41604fb6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:12.160606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527d4f8-c0ea-4132-ba97-89e41604fb6a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:12.194323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 309/615] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:12.202347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:12.338554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b0a83-d574-4df0-b6c9-769eb612cc4e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:12.338951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b0a83-d574-4df0-b6c9-769eb612cc4e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:12.339210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b0a83-d574-4df0-b6c9-769eb612cc4e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:12.340599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 310/616] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:33:12.354404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ae582-76bf-4451-8b24-9ff921609ee9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:12.354777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ae582-76bf-4451-8b24-9ff921609ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:12.355044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ae582-76bf-4451-8b24-9ff921609ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:12.376222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ac0ae582-76bf-4451-8b24-9ff921609ee9 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:12.377306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac0ae582-76bf-4451-8b24-9ff921609ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:12.391244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:12.437771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3917-3e39-4e5d-9d31-62461e8195d0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:12.468447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 311/617] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:12.469343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ae582-76bf-4451-8b24-9ff921609ee9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:12.485318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:12.536901 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:12.537549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:12.537885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:12.538121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:12.548233 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:12.549724 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:12.563979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:12.566930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 307/618] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:12.587301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:12.662189 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ae582-76bf-4451-8b24-9ff921609ee9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:12.742918 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:12.743571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:12.743852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:12.744127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:12.774087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:12.780989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:12.782777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:12.784563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:12.789924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 312/619] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:12.797535 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:12.823593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa087a63-ad06-4b1a-85b0-8defe2bd7a58 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:12.916106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:12.917047 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:12.917530 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:12.918038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:12.919364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:12.919877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:12.922523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:12.926054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:12.946068 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:12.974012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 308/620] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 22 02:33:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:12.983449 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:12.984693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d270d-94b8-4120-9f8a-eadc150f1d41 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:13.024656 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:13.025631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.026456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.026937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.027880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:13.028421 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:13.030440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:13.044122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 313/621] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:13.051535 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:13.208810 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ab20-8970-45a1-a921-04f8361bd296 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:13.260079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ca1c-863c-4bd0-b87f-2b5203a4a5f8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:13.291501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c0da-6ed6-4211-878c-e2e3babcf52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:13.292730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c0da-6ed6-4211-878c-e2e3babcf52e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.293065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c0da-6ed6-4211-878c-e2e3babcf52e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.293409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c0da-6ed6-4211-878c-e2e3babcf52e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.322191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:13.323212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.323665 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.324051 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.327276 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:13.350560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:13.353123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:13.374067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:13.375966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:13.380160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:13.380160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:13.380160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:13.380160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 314/622] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:13.380160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:13.383485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:13.400336 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c0da-6ed6-4211-878c-e2e3babcf52e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:13.401881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c0da-6ed6-4211-878c-e2e3babcf52e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:13.526381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f447fcf-b687-4f03-a5aa-73a1e0c70bbc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:13.551679 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 309/623] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:33:13.553977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b46a-cba4-4d65-bf9b-1ff66a2ba4a2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.554511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b46a-cba4-4d65-bf9b-1ff66a2ba4a2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.554934 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b46a-cba4-4d65-bf9b-1ff66a2ba4a2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.557483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 310/624] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:13.559014 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b46a-cba4-4d65-bf9b-1ff66a2ba4a2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:13.563649 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef3755-bdf3-4fb0-9450-a0135c60a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:13.564294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3755-bdf3-4fb0-9450-a0135c60a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.564580 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3755-bdf3-4fb0-9450-a0135c60a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.564859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3755-bdf3-4fb0-9450-a0135c60a4b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.576395 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef3755-bdf3-4fb0-9450-a0135c60a4b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f6ef3755-bdf3-4fb0-9450-a0135c60a4b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:13.581886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:13.589171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 315/625] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:13.590239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418dea-91af-4a78-83b5-81558aaa42c7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.591135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418dea-91af-4a78-83b5-81558aaa42c7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.591135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418dea-91af-4a78-83b5-81558aaa42c7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.591135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 316/626] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:13.591135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418dea-91af-4a78-83b5-81558aaa42c7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:13.640798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:13.699251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:13.705015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418dea-91af-4a78-83b5-81558aaa42c7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:13.712767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b46a-cba4-4d65-bf9b-1ff66a2ba4a2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:13.747301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:13.748398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.748888 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.749388 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.750570 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654ef2a-3e78-4753-b260-4402d237bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:13.751189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654ef2a-3e78-4753-b260-4402d237bd0d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.751464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654ef2a-3e78-4753-b260-4402d237bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.751735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654ef2a-3e78-4753-b260-4402d237bd0d None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.752379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654ef2a-3e78-4753-b260-4402d237bd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:13.752680 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654ef2a-3e78-4753-b260-4402d237bd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:13.754447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654ef2a-3e78-4753-b260-4402d237bd0d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:13.766615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 311/627] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:13.767871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a66cc-a503-4434-b7a5-f41b02900b18 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.767978 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:13.768157 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a66cc-a503-4434-b7a5-f41b02900b18 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.768430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a66cc-a503-4434-b7a5-f41b02900b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.770469 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:13.788527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-853a66cc-a503-4434-b7a5-f41b02900b18 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:13.790519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-853a66cc-a503-4434-b7a5-f41b02900b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:13.795279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:13.796241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:13.797115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:13.797115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:13.797115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:13.797294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 317/628] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:13.798679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:13.862694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 312/629] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:13.863857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d432-6e48-4685-84e1-2eea21c568ad None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:13.864140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d432-6e48-4685-84e1-2eea21c568ad None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:13.864413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d432-6e48-4685-84e1-2eea21c568ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:13.883509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a346d432-6e48-4685-84e1-2eea21c568ad None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:13.884722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a346d432-6e48-4685-84e1-2eea21c568ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:13.955505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:13.960120 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be2e5-2b31-451d-b5e5-b21c08fb93fc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.005681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 313/630] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:14.005681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d432-6e48-4685-84e1-2eea21c568ad None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.013853 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.014701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.015053 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.015590 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.017492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:14.018050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:14.020308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:14.025134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:14.037607 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 318/631] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:14.041007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.180009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d432-6e48-4685-84e1-2eea21c568ad None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.211982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c4c21-4457-4edb-8bb5-bd7386964087 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.238142 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.239195 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.239690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.240181 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] PATH_INFO: `/v3/users/swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.252849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.253760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.254107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:14.254392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.254813 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.255616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:14.256067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:14.256726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:14.258014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:14.273773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:14.275742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:14.277491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:14.280646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 314/632] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:14.280882 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 319/633] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:14.281872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.282116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.314692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:14.356843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:14.389989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85564af5-5b22-4dfb-97d1-01244c05059b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.436154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.436862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.437133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.437558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.437686 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69389-dc3f-415f-9914-f82b567b694a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.453256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:14.455604 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:14.472726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:14.473816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:14.474884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:14.474884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:14.474884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:14.475514 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 315/634] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:14.477405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.493362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.494027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.494307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.494582 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.508922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:14.515529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:14.516515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:14.517365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 320/635] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:14.518099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.615781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:14.627829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef4dfa-7c37-46cf-8ec2-72841a5b056e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.647364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c93dc-3de4-4bd1-b99b-5cfbe296f8f5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.665907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:14.681962 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.682939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.683385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.683828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.685077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:14.685581 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:14.688086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:14.701603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.702633 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.703090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.703541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.711157 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:14.712627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:14.712987 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 316/636] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:14.713860 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:14.734760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:14.735939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:14.736919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 321/637] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:14.737401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.842104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ff7d-9044-451b-984c-0e33d93c1573 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.856507 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce6dc6-38e5-4920-a43c-e5488e45fc83 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:14.883857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.884413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.884689 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.884962 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.896209 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:14.901192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:14.902198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:14.903123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:14.903779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:14.903779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:14.903935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 317/638] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:14.904004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:14.904004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:14.904814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.904885 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:14.905248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:14.907978 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:14.924104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:14.929850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 322/639] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:14.931738 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:14.954395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:15.022669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21123cc0-d846-41e6-aa71-b1981079a7ff None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.057667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299767-5b7c-41b4-b55e-657e013b8bef None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.064904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.065527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.065837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.066104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.066800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:15.067130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.068527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.077614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 318/640] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:15.078530 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.115571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.116330 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.116742 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.117685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.131494 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.133249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:15.151704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:15.153456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:15.155232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:15.155232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:15.155232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:15.155232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 323/641] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:15.155232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.213499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:15.215842 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4253133-aeb8-4c55-80c7-5eb23d36e90f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.218545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:15.263779 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.264524 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.264696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.264918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.265624 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:15.265951 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.267408 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.272236 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33337184-e01c-4a91-bd50-27021ba8cc3a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.281599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 319/642] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:15.282747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.321560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.322229 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.322502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.322778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.323458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:15.323766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.325323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.334414 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 324/643] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:15.335277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.427504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853d43-28ee-4a68-bcfc-db8ed19fce94 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.461229 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666d86-5bd5-40ce-a441-86a7f094b7c3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.484941 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:15.488818 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.489727 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.489912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.490370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.500882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.502749 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.515795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.516621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:15.516993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:15.518999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 02:33:15.521612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:15.524356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.524356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.525049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 320/644] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:15.525049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.542499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.545076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.560734 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:15.564840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:15.566720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:15.568470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:15.568470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:15.568470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:15.568470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 325/645] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:15.568470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.682220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c3bf-9e51-4631-9835-7109b4b08ec6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.717172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa80cb-920a-42aa-9487-ab28569ac63f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.727473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.728509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.728988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.729574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.730630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:15.731161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.733802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.755594 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:15.755919 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 321/646] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:15.756245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:15.756528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:15.756828 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:15.757343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.758136 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=a5cf3b19d04044fda6a4aa1b5d7aff2c) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:15.758499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:15.760013 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:15.767068 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 326/647] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/role_assignments?user.id=a5cf3b19d04044fda6a4aa1b5d7aff2c&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:15.767929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:15.828071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:15.917292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:15.948895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb247995-4e28-4c96-b6a7-3fc4a306294c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:15.954501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a9b0f-2b7f-4e98-8939-5c4561cdd715 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:16.014253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.015269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.015749 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.016285 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.017294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.017469 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.017784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.018067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.019456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:16.019768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.021849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.036482 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.038796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.053041 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 327/648] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:16.053041 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:16.068582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:16.070936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:16.072662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:16.072662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:16.072662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:16.072662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 322/649] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:16.072662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.186909 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:16.200827 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c5c5-990e-48ce-a0c8-404175969bb6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:16.208731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3bd5-bb2e-4e8e-b0a1-8269d5984834 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:16.239554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.240488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.240776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.241054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.245086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:16.250320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.252692 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:16.266000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:16.266997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:16.267899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 323/650] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:16.268379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.282348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227a29-e640-450e-8815-0215252a139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.283404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227a29-e640-450e-8815-0215252a139b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.283905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227a29-e640-450e-8815-0215252a139b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.284403 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227a29-e640-450e-8815-0215252a139b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.285535 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02227a29-e640-450e-8815-0215252a139b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:16.286111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02227a29-e640-450e-8815-0215252a139b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.288781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02227a29-e640-450e-8815-0215252a139b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.314931 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 328/651] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:16.314931 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227a29-e640-450e-8815-0215252a139b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.407231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54118e5-027c-4bc0-a4a0-238a061fbad3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:16.448532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.449176 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.449458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.449767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.490673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227a29-e640-450e-8815-0215252a139b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:16.534854 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:16.539432 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.542984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.550690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.551640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.552091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.552533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.553610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:16.554153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.556643 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.577439 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 329/652] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:16.579191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.597027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:16.695695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 324/653] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:33:16.696776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.742072 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f09a4-aaa4-4ffd-8200-9aeac172c6d2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:16.801819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.802792 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.803230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.803655 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.805409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:16.806027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.808303 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.834195 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 330/654] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:16.835385 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.846528 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:16.856099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfbcc-4668-4f8b-b244-64b706d6f916 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:16.899776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:16.900429 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:16.900767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:16.901048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:16.909681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:16.911147 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:16.924982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:16.926070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 02:33:16.927714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:16.928521 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:16.931003 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 325/655] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:16.931992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:16.974640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65bc8-478f-42c1-87e1-0857e0b6e0bd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:17.018856 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:17.019398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:17.019691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:17.019946 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:17.030895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:17.032588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:17.049226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:17.059248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 331/656] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:17.061143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:17.131078 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e12b3-8c7b-4e4d-8eff-fb735c2d83c0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:17.195497 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:17.196549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:17.197011 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:17.197462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:17.216861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:17.219599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:17.240234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f29d6-0eec-41ba-9065-f0d8e29d5ea0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:17.246304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:17.247271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:17.248160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:17.248160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:17.248160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:17.248794 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 326/657] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:17.250205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:17.276050 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:17.280854 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:17.297120 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:17.298370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:17.298773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:17.299177 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/04490cc2eef14514bc2834de17458744/roles/04e96ff01f0a484ba43803759e6eabe9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:17.332469 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=04490cc2eef14514bc2834de17458744, role_id=04e96ff01f0a484ba43803759e6eabe9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:17.336051 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:17.358244 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 332/658] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:17 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/04490cc2eef14514bc2834de17458744/roles/04e96ff01f0a484ba43803759e6eabe9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:33:17.359412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:17.474816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489fc25-c37d-4ff2-bc98-6be95c0727a7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:17.552984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:17.554469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:17.554968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:17.555452 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:17.557431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:17.557984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:17.561951 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:17.563876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11494-337c-4869-82bd-20342404ee70 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:17.605599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 327/659] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Sep 22 02:33:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:17.606946 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:17.646520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:17.647505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:17.648140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:17.649147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:17.650504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:17.651018 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:17.653620 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:17.689576 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 333/660] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:33:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:17.691211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:17.738214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:17.761148 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:17.803950 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42989f7-9db7-4403-a290-e880364e38dd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:17.871439 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:17.872583 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:17.873124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:17.873615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:17.874897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:17.875443 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:17.878191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:17.901785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 328/661] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:17.903281 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:17.908311 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539a9a0-10f2-40e4-87e4-8b1f8d7001cd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:17.976054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:17.977614 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:17.978121 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:17.978600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:18.095901 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a11db9-c284-4332-b468-8a06f40dfe94 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:18.114213 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:18.116903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:18.146283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:18.164213 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:18.165883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:18.166569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:18.167262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:18.181763 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:18.308634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 334/662] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:33:18.310145 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:18.316082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:18.319070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:18.498233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b6a7e-8d09-4c3c-b4f6-24c81fb6582c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:18.525596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 329/663] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:33:18.527314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:18.563827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:18.564872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:18.565808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:18.565974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:18.577813 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:18.579849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:18.583632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:18.595073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:18.608525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:18.610426 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:18.612291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 335/664] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:18.613221 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:18.744628 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1bab-4106-4969-8b48-5978591ce67d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:18.769006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f321a4-781d-4169-819a-b97a56ba43d0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:18.800592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309d527-9566-4b29-9b89-5a25e2b1e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:18.801226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309d527-9566-4b29-9b89-5a25e2b1e481 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:18.801506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309d527-9566-4b29-9b89-5a25e2b1e481 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:18.801806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309d527-9566-4b29-9b89-5a25e2b1e481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:18.822782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:18.823600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:18.823784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:18.824210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:18.825369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309d527-9566-4b29-9b89-5a25e2b1e481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:18.828805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309d527-9566-4b29-9b89-5a25e2b1e481 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:18.835768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:18.837240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:18.853850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:18.855773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:18.858423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:18.858423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:18.858423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:18.859933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 336/665] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5309d527-9566-4b29-9b89-5a25e2b1e481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:18.860205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:18.871116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:18.876698 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:18.876698 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:18.876698 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:18.877358 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:18.877607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 330/666] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:18.877607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b1428-3c6f-496f-b23f-40c3ed612e33 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:18.877607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b1428-3c6f-496f-b23f-40c3ed612e33 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:18.877607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b1428-3c6f-496f-b23f-40c3ed612e33 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:18.877607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 331/667] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:18.877607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b1428-3c6f-496f-b23f-40c3ed612e33 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:18.937523 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:19.008606 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:19.028282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf583-cf5a-414a-9a68-b5ced8328dc4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.045448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b1428-3c6f-496f-b23f-40c3ed612e33 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.081591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac562e1-c0a0-410c-80f4-1996cd303151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.082761 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac562e1-c0a0-410c-80f4-1996cd303151 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.083210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac562e1-c0a0-410c-80f4-1996cd303151 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.083679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac562e1-c0a0-410c-80f4-1996cd303151 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.084649 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac562e1-c0a0-410c-80f4-1996cd303151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:19.085122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac562e1-c0a0-410c-80f4-1996cd303151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.087433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac562e1-c0a0-410c-80f4-1996cd303151 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:19.100566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.101885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.102245 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.102615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.103345 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:19.103912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 337/668] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:19.105393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9317a9-5e41-480e-b857-41f1da00a576 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.105892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9317a9-5e41-480e-b857-41f1da00a576 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.106326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9317a9-5e41-480e-b857-41f1da00a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.108503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.109969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:19.129782 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 332/669] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:19.129782 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:19.131974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ef9317a9-5e41-480e-b857-41f1da00a576 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:19.134687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ef9317a9-5e41-480e-b857-41f1da00a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:19.247973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 338/670] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:19.249353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9317a9-5e41-480e-b857-41f1da00a576 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:19.320701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:19.322734 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8d29c-f612-411e-af9a-240f1f0caa90 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.392471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.393586 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.394132 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.394647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.395844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:19.396422 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.399775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:19.412827 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:19.417791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9317a9-5e41-480e-b857-41f1da00a576 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.422797 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 333/671] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:19.424373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:19.467048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.468272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.468762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.469244 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.470485 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=78a88b5980e5458198ad510ff8bf2994) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:19.470995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.473139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:19.490168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 339/672] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:19 2022] GET /identity/v3/role_assignments?user.id=78a88b5980e5458198ad510ff8bf2994&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:19.493238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:19.613105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bcc8f-5a67-4d2f-acce-14a4d2888023 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.646357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461387-ab4a-4b32-8c61-4117a87d1a3f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.649245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:19.678195 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.679098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.679563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.679843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.692271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.694776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:19.702538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.703660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.704152 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.704721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:19.713706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:19.714722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:19.715657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:19.717912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.719910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:19.721539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 334/673] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:19.722942 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:19.737266 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:19.738353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:19.739245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:19.742408 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 340/674] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:19.743664 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:19.815729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:19.887762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc467a-e2a8-4799-8a38-7d67d751029f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.915860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea33ce-982b-4b26-bb85-aa212b6e20ff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:19.957953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.958594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.958874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.959139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.959736 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.961700 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:19.972155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:19.973180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:19.973709 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:19.973872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:19.976124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:19.977701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:19.980844 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:19.981084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 335/675] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Sep 22 02:33:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:19.981314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:19.981563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:19.981923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:19.981923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:20.012901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 341/676] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:20.016087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:20.061748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:20.179651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00ad4-6cc5-4b94-9594-2449345b63ab None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:20.187498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ab1c-5672-4d5d-8146-002139de4aad None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:20.217793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:20.218432 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:20.218703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:20.218949 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:20.219580 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:20.219878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:20.221237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:20.231746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 342/677] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 22 02:33:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:20.232754 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:20.234204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:20.256225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:20.258264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:20.259037 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:20.259791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:20.261368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:20.262225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:20.266710 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:20.289526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 336/678] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:20.291725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:20.342468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:20.368626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550ea8e-c50d-4a0f-a639-3f6397876e4b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:20.407693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32552f26-915d-4b02-b142-b48e814657a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:20.408427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552f26-915d-4b02-b142-b48e814657a4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:20.408590 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552f26-915d-4b02-b142-b48e814657a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:20.408846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552f26-915d-4b02-b142-b48e814657a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:20.409581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32552f26-915d-4b02-b142-b48e814657a4 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=94bfeac1fea64803913036131d3bc6f5) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:20.410008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32552f26-915d-4b02-b142-b48e814657a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:20.411423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32552f26-915d-4b02-b142-b48e814657a4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:20.425687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 343/679] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:20 2022] GET /identity/v3/role_assignments?user.id=94bfeac1fea64803913036131d3bc6f5&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:20.425687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d23bf0-c387-458f-94ea-99ac3f7df812 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:20.425687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d23bf0-c387-458f-94ea-99ac3f7df812 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:20.425687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d23bf0-c387-458f-94ea-99ac3f7df812 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:20.425687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 344/680] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:20.425687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d23bf0-c387-458f-94ea-99ac3f7df812 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:20.441367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b89712-88ba-4ebb-a925-153de3bdc232 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:20.485781 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d5124-bb0c-46fd-b610-6bd06aaf7fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:20.486416 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d5124-bb0c-46fd-b610-6bd06aaf7fdf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:20.486988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d5124-bb0c-46fd-b610-6bd06aaf7fdf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:20.487274 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d5124-bb0c-46fd-b610-6bd06aaf7fdf None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:20.488574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d5124-bb0c-46fd-b610-6bd06aaf7fdf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:20.488888 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d5124-bb0c-46fd-b610-6bd06aaf7fdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:20.490904 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d5124-bb0c-46fd-b610-6bd06aaf7fdf None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:20.505644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 337/681] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 22 02:33:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:20.507215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7f836-cdc4-42a7-94c4-480c37a615e7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:20.507540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7f836-cdc4-42a7-94c4-480c37a615e7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:20.507812 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7f836-cdc4-42a7-94c4-480c37a615e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:20.548970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7cb7f836-cdc4-42a7-94c4-480c37a615e7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:20.550298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7cb7f836-cdc4-42a7-94c4-480c37a615e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:20.608822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d23bf0-c387-458f-94ea-99ac3f7df812 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:20.652850 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:20.692973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:20.693833 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:20.693833 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:20.694091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:20.694736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=5cb868fc365140a39e3f64166df3e1ba) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:20.695106 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:20.696611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:20.707814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 345/682] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:20 2022] GET /identity/v3/role_assignments?user.id=5cb868fc365140a39e3f64166df3e1ba&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:20.717866 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 338/683] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:21.001629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:21.020752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:21.161606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532115b4-8ed4-4be0-8313-625900594627 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:21.227415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:21.228402 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:21.228751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:21.229196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:21.245744 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:21.255444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:21.256407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:21.257241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:21.262173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 346/684] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:21.267120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7f836-cdc4-42a7-94c4-480c37a615e7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:21.446575 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7f836-cdc4-42a7-94c4-480c37a615e7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:21.511867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:21.512796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:21.513278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:21.513785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:21.515022 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:21.515441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:21.517881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:21.532020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 339/685] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:21.541949 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:21.639005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:21.670060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abcbdc-c67d-4b38-919f-32c7653e4024 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:21.707091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:21.707789 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:21.708020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:21.708260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:21.720427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:21.721968 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:21.737497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:21.738545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:21.739435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:21.739435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:21.739435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:21.743267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 347/686] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:21.745418 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:21.800220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:21.887428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaba54-28ac-4efe-91dd-9ea0c8f34101 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:21.932213 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:21.932886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:21.933165 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:21.933434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:21.934117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:21.934416 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:21.935865 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:21.954967 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 340/687] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:21.961260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:22.073415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235867cd-a4ef-4b41-a34a-6fd66e246fb4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:22.106247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:22.116032 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71eab3-d0d9-407c-8385-fcdf25b78e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:22.116706 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eab3-d0d9-407c-8385-fcdf25b78e4a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:22.118481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eab3-d0d9-407c-8385-fcdf25b78e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:22.118830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eab3-d0d9-407c-8385-fcdf25b78e4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:22.127731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71eab3-d0d9-407c-8385-fcdf25b78e4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:22.129206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71eab3-d0d9-407c-8385-fcdf25b78e4a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8c71eab3-d0d9-407c-8385-fcdf25b78e4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:22.146533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:22.148926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:22.150593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 348/688] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:22.159131 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:22.296824 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:22.303790 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17bb4f-bed6-491d-ad54-ef38168d3c69 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:22.361925 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17df0-fd8d-4432-b7c7-b674473aaac0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:22.362336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17df0-fd8d-4432-b7c7-b674473aaac0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:22.362912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17df0-fd8d-4432-b7c7-b674473aaac0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:22.365525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 349/689] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:22.368617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:22.369766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:22.370366 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:22.370879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:22.371671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce25058-8746-47ef-ac1a-a4f2b7895469 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:22.371956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce25058-8746-47ef-ac1a-a4f2b7895469 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:22.372233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce25058-8746-47ef-ac1a-a4f2b7895469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:22.372335 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:22.372886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:22.375596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:22.417889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 341/690] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 22 02:33:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:22.418926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3ce25058-8746-47ef-ac1a-a4f2b7895469 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:22.420220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3ce25058-8746-47ef-ac1a-a4f2b7895469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:22.422203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:22.558199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 350/691] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:22.633184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe4b20-0968-4b5a-919a-2e0aedb9716e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:22.691334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:22.692025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:22.692312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:22.692581 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:22.732761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:22.793181 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:22.794680 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:22.924761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 342/692] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:33:22.930657 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce25058-8746-47ef-ac1a-a4f2b7895469 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:22.966312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:23.074914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce25058-8746-47ef-ac1a-a4f2b7895469 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:23.086053 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:23.138048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:23.147056 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:23.147707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.148016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.148295 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.160354 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:23.161909 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:23.173841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697312a-2552-48c9-b265-79e6ea0f29dc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:23.182233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:23.183222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:23.184230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:23.184230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:23.184230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:23.184230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 351/693] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:23.190959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:23.245772 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:23.246792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.247276 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.247754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.270758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:23.272238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:23.297149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:23.298287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:23.299193 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:23.299193 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:23.299193 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:23.305689 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 343/694] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:23.311085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:23.401267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcc88e-5c96-4360-9b4d-540510eddee7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:23.469239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cb269-dc82-4d14-88b0-99dab41d205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:23.470441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb269-dc82-4d14-88b0-99dab41d205d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.471122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb269-dc82-4d14-88b0-99dab41d205d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.471588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb269-dc82-4d14-88b0-99dab41d205d None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.472478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb269-dc82-4d14-88b0-99dab41d205d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:23.472836 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb269-dc82-4d14-88b0-99dab41d205d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:23.475870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb269-dc82-4d14-88b0-99dab41d205d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:23.504992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 352/695] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:23.508119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531bf20-e954-4bda-a9f9-38ed8a8e3e51 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.508586 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531bf20-e954-4bda-a9f9-38ed8a8e3e51 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.509077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531bf20-e954-4bda-a9f9-38ed8a8e3e51 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.510918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcbecb-711b-4683-87fb-f1f9b23ddf35 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:23.511912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 353/696] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:23.513135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531bf20-e954-4bda-a9f9-38ed8a8e3e51 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:23.531305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:23.562938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:23.576623 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab4403-b99d-4903-b461-5658b8dd683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:23.577337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4403-b99d-4903-b461-5658b8dd683a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.577619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4403-b99d-4903-b461-5658b8dd683a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.577953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4403-b99d-4903-b461-5658b8dd683a None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.578814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4403-b99d-4903-b461-5658b8dd683a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:23.579204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4403-b99d-4903-b461-5658b8dd683a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:23.581000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4403-b99d-4903-b461-5658b8dd683a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:23.605203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 344/697] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:23.606991 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242fcc4-1e9d-4230-8adf-e2d83ef3b98e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.607282 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242fcc4-1e9d-4230-8adf-e2d83ef3b98e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.607613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242fcc4-1e9d-4230-8adf-e2d83ef3b98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.629491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3242fcc4-1e9d-4230-8adf-e2d83ef3b98e None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:23.630752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3242fcc4-1e9d-4230-8adf-e2d83ef3b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:23.668210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531bf20-e954-4bda-a9f9-38ed8a8e3e51 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:23.707147 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 345/698] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:23.708125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242fcc4-1e9d-4230-8adf-e2d83ef3b98e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:23.709578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:23.710717 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.711224 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.711767 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.720032 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:23.722008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:23.735451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:23.736409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:23.737315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:23.739854 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 354/699] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:23.748490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:23.813668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:23.817579 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242fcc4-1e9d-4230-8adf-e2d83ef3b98e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:23.854578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:23.871284 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d654-fe11-4fa5-8202-c2540a29154c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:23.877239 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6413a7-4c6c-46b5-92b1-84f32949bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:23.878421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6413a7-4c6c-46b5-92b1-84f32949bc84 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.878998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6413a7-4c6c-46b5-92b1-84f32949bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.879491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6413a7-4c6c-46b5-92b1-84f32949bc84 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.881054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6413a7-4c6c-46b5-92b1-84f32949bc84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:23.884542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6413a7-4c6c-46b5-92b1-84f32949bc84 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:23.917524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:23.918519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.919017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.919538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.920487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:23.920997 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:23.922837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:23.925537 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 346/700] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:33:23 2022] POST /identity/v3/users => generated 254 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:33:23.927862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836235ad-3fa0-4532-a758-cd1e2eb5b6d8 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.928140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836235ad-3fa0-4532-a758-cd1e2eb5b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.928552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836235ad-3fa0-4532-a758-cd1e2eb5b6d8 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.935464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 347/701] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:23.937248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db804-3bb0-4e8f-b701-b83984c3f6f7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:23.937799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db804-3bb0-4e8f-b701-b83984c3f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:23.938187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db804-3bb0-4e8f-b701-b83984c3f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:23.957317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 355/702] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:23.963847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:23.980732 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c13db804-3bb0-4e8f-b701-b83984c3f6f7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:23.983266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c13db804-3bb0-4e8f-b701-b83984c3f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:24.092758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 348/703] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:33:24.095279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db804-3bb0-4e8f-b701-b83984c3f6f7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:24.124845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1832a-a978-4f03-ba51-5a97bf629380 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:24.176034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7764dc5-7f28-4045-ae3e-4accc2598e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:24.176655 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764dc5-7f28-4045-ae3e-4accc2598e06 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:24.176937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764dc5-7f28-4045-ae3e-4accc2598e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:24.177218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764dc5-7f28-4045-ae3e-4accc2598e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:24.177996 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7764dc5-7f28-4045-ae3e-4accc2598e06 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=04490cc2eef14514bc2834de17458744) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:24.178307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7764dc5-7f28-4045-ae3e-4accc2598e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:24.180350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7764dc5-7f28-4045-ae3e-4accc2598e06 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:24.189313 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 356/704] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:23 2022] GET /identity/v3/role_assignments?user.id=04490cc2eef14514bc2834de17458744&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:24.192174 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8f44-7c38-4310-99b6-23667f7eb730 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:24.192683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8f44-7c38-4310-99b6-23667f7eb730 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:24.193188 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8f44-7c38-4310-99b6-23667f7eb730 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:24.196181 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 357/705] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:24.203178 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474a9b-60ea-484d-8626-8b23bb749617 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:24.204102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474a9b-60ea-484d-8626-8b23bb749617 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:24.204943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474a9b-60ea-484d-8626-8b23bb749617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:24.233884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:24.243683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b8474a9b-60ea-484d-8626-8b23bb749617 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:24.245368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b8474a9b-60ea-484d-8626-8b23bb749617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:24.256714 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:24.269540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db804-3bb0-4e8f-b701-b83984c3f6f7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:24.312722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:24.313333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:24.313613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:24.313935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:24.314609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:24.316007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:24.335875 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 349/706] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:33:24 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:33:24.381735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 358/707] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:24.404840 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:24.539593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a557e-2d4f-4c29-9038-cdff21c0e856 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:24.580114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:24.580758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:24.581036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:24.581302 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:24.593817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:24.599547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:24.600533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:24.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 350/708] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:24.608110 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474a9b-60ea-484d-8626-8b23bb749617 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:24.704697 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:24.719596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:24.741363 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474a9b-60ea-484d-8626-8b23bb749617 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:24.782626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:24.783699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:24.784213 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:24.784700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:24.785678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:24.786301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:24.787993 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:24.796949 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:24.799780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 359/709] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:24.808135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:24.946418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae281a-4e3c-4185-8f4e-c67ea7f69c36 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:25.002979 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:25.005178 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:25.006110 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:25.006916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:25.029374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:25.032381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:25.060459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:25.062333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:25.064168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:25.064168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:25.064168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:25.073744 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 360/710] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:25.080128 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:25.130636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa63a-fec4-474e-b53f-88249c8a0488 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:25.202243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:25.238160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:25.239640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:25.240004 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:25.240364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:25.241312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:25.244341 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:25.274964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:25.276992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:25.278785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:25.281524 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 351/711] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:24 2022] GET /identity/v3/services/network => generated 88 bytes in 577 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:25.286259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:25.335937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2a0b-9237-4d6f-8be2-cca5b84a71ca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:25.435167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:25.435815 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:25.436109 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:25.436396 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:25.436564 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:25.437048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:25.437352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:25.438916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:25.467976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 361/712] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:25.475837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:25.498764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833c8c-be6a-4abc-98c4-ed523d65e4a2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:25.580885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:25.587627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:25.589747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:25.591575 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:25.596959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] RBAC: Adding query filter params (name=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:25.597851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:25.600740 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:25.622947 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 352/713] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:33:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:25.626897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:25.819691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef58e0-c168-4208-8059-81c78e195188 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:25.841308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:25.845620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9413dd-c0a9-4549-84a8-5fce3778662a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:25.869128 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:25.870258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:25.870785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:25.871274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:25.880376 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:25.882415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:25.896458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:25.897467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:25.898973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:25.901546 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 362/714] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:33:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:25.907382 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:25.909027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:25.915870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:25.916714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:25.917167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:25.917667 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:25.918953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:25.919380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:25.922021 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:25.936486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 353/715] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:33:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:26.033551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f68a-82b9-4adb-959b-b5776e1b6e1f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:26.073977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:26.075006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:26.075518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:26.076001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:26.077000 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:26.077529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:26.079395 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:26.100925 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 363/716] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:33:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:26.108235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:26.254781 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7500b-d9f1-471d-9d91-3067386102f5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:26.316944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:26.318563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:26.319335 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:26.320662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:26.451742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:26.476294 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:26.479559 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:26.701422 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 354/717] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:26 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 02:33:26.710967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:26.750953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:26.826256 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758f86-eb8a-4823-b6e7-ae9e52e12d45 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:26.864978 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef0267-59a8-4509-be0d-f23a41bbb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:26.865707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef0267-59a8-4509-be0d-f23a41bbb738 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:26.865995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef0267-59a8-4509-be0d-f23a41bbb738 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:26.866276 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef0267-59a8-4509-be0d-f23a41bbb738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:26.879014 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef0267-59a8-4509-be0d-f23a41bbb738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:26.880504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef0267-59a8-4509-be0d-f23a41bbb738 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b9ef0267-59a8-4509-be0d-f23a41bbb738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:26.898652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:26.900410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:26.903503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:26.903503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:26.903503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:26.903503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 364/718] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:26.909580 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:27.078471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:27.085138 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291efcc8-5509-4285-842f-465c23aeb97a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:27.107458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d751-d461-45e7-a82d-4f72749ce340 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.108456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d751-d461-45e7-a82d-4f72749ce340 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.109089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d751-d461-45e7-a82d-4f72749ce340 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.110785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 365/719] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:33:27.117364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf25ed2-1c85-422a-ae0f-77989e871156 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.118285 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf25ed2-1c85-422a-ae0f-77989e871156 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.118777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf25ed2-1c85-422a-ae0f-77989e871156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.138750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ddf25ed2-1c85-422a-ae0f-77989e871156 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:27.140390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ddf25ed2-1c85-422a-ae0f-77989e871156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:27.144611 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45108797-b9ef-406b-a05b-d1fd69e89470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:27.144813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45108797-b9ef-406b-a05b-d1fd69e89470 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.145256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45108797-b9ef-406b-a05b-d1fd69e89470 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.145546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45108797-b9ef-406b-a05b-d1fd69e89470 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.146256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45108797-b9ef-406b-a05b-d1fd69e89470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:27.146564 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45108797-b9ef-406b-a05b-d1fd69e89470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:27.148034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45108797-b9ef-406b-a05b-d1fd69e89470 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:27.163371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 355/720] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:27.169911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dc085-d0cf-47ba-80c9-248ae32411cf None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.169911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dc085-d0cf-47ba-80c9-248ae32411cf None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.169911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dc085-d0cf-47ba-80c9-248ae32411cf None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.169911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 356/721] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:27.174706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dc085-d0cf-47ba-80c9-248ae32411cf None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:27.238307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 366/722] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 02:33:27.240939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8713-25de-4077-81d0-1391d2c67c27 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.241067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8713-25de-4077-81d0-1391d2c67c27 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.241344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8713-25de-4077-81d0-1391d2c67c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.274707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a7ae8713-25de-4077-81d0-1391d2c67c27 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:27.275924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a7ae8713-25de-4077-81d0-1391d2c67c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:27.284834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:27.381040 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dc085-d0cf-47ba-80c9-248ae32411cf None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:27.402563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 367/723] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:27.466092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:27.467161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.467640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.468120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.485344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:27.488016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:27.510092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:27.511231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:27.512306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:27.512776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 357/724] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:27.519714 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8713-25de-4077-81d0-1391d2c67c27 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:27.606733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:27.638347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:27.760917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad974f2-180c-41bc-978d-bd95c9974a20 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:27.785635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8713-25de-4077-81d0-1391d2c67c27 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:27.812439 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd0b1b-4fcf-4512-ac6d-a5c17cb0e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:27.814073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0b1b-4fcf-4512-ac6d-a5c17cb0e725 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.814888 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0b1b-4fcf-4512-ac6d-a5c17cb0e725 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.815379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0b1b-4fcf-4512-ac6d-a5c17cb0e725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.827987 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde7ca2-d938-41cf-9b5f-5e1ebd9f06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:27.828608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7ca2-d938-41cf-9b5f-5e1ebd9f06be None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.828891 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7ca2-d938-41cf-9b5f-5e1ebd9f06be None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.829168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7ca2-d938-41cf-9b5f-5e1ebd9f06be None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.829913 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde7ca2-d938-41cf-9b5f-5e1ebd9f06be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:27.830231 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde7ca2-d938-41cf-9b5f-5e1ebd9f06be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:27.831479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd0b1b-4fcf-4512-ac6d-a5c17cb0e725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:27.831784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde7ca2-d938-41cf-9b5f-5e1ebd9f06be None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-f4dd0b1b-4fcf-4512-ac6d-a5c17cb0e725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:27.838107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:27.839115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:27.839948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:27.843229 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 358/725] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:27.848631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdfaaf-c6a6-4488-a1b6-7d71db0bd0de None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.848631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdfaaf-c6a6-4488-a1b6-7d71db0bd0de None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.848631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdfaaf-c6a6-4488-a1b6-7d71db0bd0de None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.849932 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 359/726] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:27.850531 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdfaaf-c6a6-4488-a1b6-7d71db0bd0de None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:27.856075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 368/727] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:27.861943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc334b1-c18e-41c1-b041-db3f474a6884 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:27.862328 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc334b1-c18e-41c1-b041-db3f474a6884 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:27.862618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc334b1-c18e-41c1-b041-db3f474a6884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:27.873717 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:27.887976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-edc334b1-c18e-41c1-b041-db3f474a6884 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:27.889901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-edc334b1-c18e-41c1-b041-db3f474a6884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:27.961201 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:27.981842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 369/728] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:27.983301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc334b1-c18e-41c1-b041-db3f474a6884 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:28.004218 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdfaaf-c6a6-4488-a1b6-7d71db0bd0de None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:28.065615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:28.066615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:28.067090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:28.067560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:28.068716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:28.069240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:28.071675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:28.087513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 360/729] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:28.089014 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:28.183869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc334b1-c18e-41c1-b041-db3f474a6884 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:28.247335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:28.259058 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:28.259324 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ee23-98e5-4cff-bc01-8ec7297dd000 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:28.260649 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:28.261478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:28.262561 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:28.265323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=94bfeac1fea64803913036131d3bc6f5) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:28.266232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:28.269164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:28.282639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 370/730] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:27 2022] GET /identity/v3/role_assignments?user.id=94bfeac1fea64803913036131d3bc6f5&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:28.284995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:28.336180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:28.337277 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:28.337785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:28.338251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:28.350651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:28.358430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:28.368279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:28.370234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:28.371862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:28.377834 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 361/731] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:28.380205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:28.521025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e3b7-a5bf-40f1-8247-f8b1b6991dfa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:28.577968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d3be6-1e01-4577-a293-1f127083bb89 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:28.580617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:28.581446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:28.581866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:28.582254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:28.596220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:28.598464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:28.624168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:28.626172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:28.628258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:28.628258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:28.628258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:28.633419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 371/732] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:28.634556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:28.675765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:28.678131 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:28.679856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:28.680569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:28.682839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:28.686610 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:28.705300 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:28.710519 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:28.712499 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:28.722149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 362/733] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Sep 22 02:33:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:28.722999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:28.811736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a003e-27be-4bf5-a12f-fd172c428fc7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:28.859831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:28.867348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:28.868409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:28.869442 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:28.870052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:28.871311 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:28.871859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:28.874790 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:28.890094 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 372/734] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:28.891952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:28.909666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c6a24-4286-4f1d-b1f6-0032ec38d19a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:28.958484 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:28.959632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:28.960196 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:28.961192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:28.962399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:28.963989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:28.965646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:28.986155 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 363/735] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:28.987540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:29.068214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bffa2-b07b-43a2-b404-33e22ea251da None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:29.088528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:29.130377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:29.131113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.131454 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.131799 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.132541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:29.132910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:29.134414 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:29.139893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 373/736] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 22 02:33:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:29.140779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:29.153378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67af25-bd6f-4041-9ec1-70e7e5291b96 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:29.182754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:29.205032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98631935-eccc-4044-848c-27e7379e1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:29.206166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98631935-eccc-4044-848c-27e7379e1745 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.206624 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98631935-eccc-4044-848c-27e7379e1745 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.207022 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98631935-eccc-4044-848c-27e7379e1745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.226920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98631935-eccc-4044-848c-27e7379e1745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:29.230006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98631935-eccc-4044-848c-27e7379e1745 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-98631935-eccc-4044-848c-27e7379e1745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:29.261292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:29.263651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:29.265448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:29.265448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:29.265448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:29.265448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 364/737] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:29.266545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aac1c-399c-4498-a106-54cc3b2ee113 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.266545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aac1c-399c-4498-a106-54cc3b2ee113 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.267050 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aac1c-399c-4498-a106-54cc3b2ee113 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.270534 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 365/738] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:29.271948 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1aac1c-399c-4498-a106-54cc3b2ee113 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:29.280541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f78e3-6dc2-47a7-94e8-bb12d1b1fad0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:29.324762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:29.325314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.325635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.325919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.336668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:29.338163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:29.350605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:29.352506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 374/739] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:29.354466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:29.417355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:29.474204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1aac1c-399c-4498-a106-54cc3b2ee113 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:29.518392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee84c2e-f718-45c1-8b72-5c3076c38046 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:29.542026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62ca21-0bc4-487e-bb1e-16dfa090e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:29.543049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ca21-0bc4-487e-bb1e-16dfa090e8fb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.543508 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ca21-0bc4-487e-bb1e-16dfa090e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.543993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ca21-0bc4-487e-bb1e-16dfa090e8fb None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.545133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62ca21-0bc4-487e-bb1e-16dfa090e8fb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:29.545925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62ca21-0bc4-487e-bb1e-16dfa090e8fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:29.548379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62ca21-0bc4-487e-bb1e-16dfa090e8fb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:29.565371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 366/740] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 22 02:33:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:29.565371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd2103-ade4-4445-98b4-19076e175106 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.565371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd2103-ade4-4445-98b4-19076e175106 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.565371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd2103-ade4-4445-98b4-19076e175106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.567804 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:29.568466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.568746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.569023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.573062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:29.573431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:29.574998 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:29.588878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 375/741] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:29.589784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:29.598061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-05dd2103-ade4-4445-98b4-19076e175106 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:29.600301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-05dd2103-ade4-4445-98b4-19076e175106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:29.657564 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:29.724399 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:29.740619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 367/742] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 02:33:29.740619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd2103-ade4-4445-98b4-19076e175106 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:29.744387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f259e0-b251-4a1e-b9df-d8a1b8747830 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:29.792674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:29.793470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.793927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.794205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.795032 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:29.795340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:29.796837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:29.837609 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 376/743] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 22 02:33:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:29.839870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:29.934349 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd2103-ade4-4445-98b4-19076e175106 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:29.974751 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:29.975601 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:29.975938 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:29.976301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:29.977370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] RBAC: Adding query filter params (interface=public, service_id=416d04432bdc4d28906a38f7e3763009, region_id=RegionOne) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:29.977790 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:29.979667 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:29.997376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 368/744] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:33:29 2022] GET /identity/v3/endpoints?service_id=416d04432bdc4d28906a38f7e3763009&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:29.998729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:30.000391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290821bc-7e34-4c4c-a07c-835671d66322 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:30.039643 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:30.040696 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:30.040978 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:30.041370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:30.045745 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:30.051893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:30.053772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:30.068707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:30.069957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:30.071066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:30.073278 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 377/745] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:33:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:30.074448 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:30.111669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:30.159171 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229d264-abb1-466b-8bda-18dadb5319fd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:30.224546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:30.225586 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:30.226642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:30.227119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:30.252848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbca2e2-785a-4aaa-8ca3-2eff308380f9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:30.302919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:30.303879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:30.303879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:30.304691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:30.305255 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:30.307149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:30.312718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 378/746] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:33:30 2022] GET /identity/v3/services => generated 544 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:30.313568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:30.356954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:30.358506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:30.434188 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:30.502744 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:30.552688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c52e06-4c08-434e-b2c1-70aa74798f60 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:30.579822 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 369/747] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 02:33:30.580477 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:30.645498 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:30.646765 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:30.647116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:30.647610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:30.650326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:30.650888 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:30.653993 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:30.701585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 379/748] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 22 02:33:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:30.701585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:30.784886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a1eb0-c5ba-4b60-bb9d-49253819383c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:30.822898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:30.829274 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:30.830392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:30.830392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:30.830711 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:30.831240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:30.832638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:30.852696 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fed55-12b4-4944-9a92-7b292d625ed5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:30.857957 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 370/749] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:33:30 2022] POST /identity/v3/services => generated 240 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:33:30.857957 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:30.909855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:30.916743 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3926a-177a-4851-aaf0-258008f06866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:30.917839 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3926a-177a-4851-aaf0-258008f06866 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:30.918052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3926a-177a-4851-aaf0-258008f06866 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:30.918391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3926a-177a-4851-aaf0-258008f06866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:30.935673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3926a-177a-4851-aaf0-258008f06866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:30.937963 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3926a-177a-4851-aaf0-258008f06866 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-28b3926a-177a-4851-aaf0-258008f06866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:30.962880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:30.964046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:30.964985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:30.964985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:30.964985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:30.969294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 380/750] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:30.971593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633803-ed02-4cf5-baa8-9d8e38be6293 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:30.971990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633803-ed02-4cf5-baa8-9d8e38be6293 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:30.972273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633803-ed02-4cf5-baa8-9d8e38be6293 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:30.977806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 381/751] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:30.977806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1633803-ed02-4cf5-baa8-9d8e38be6293 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:31.036200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd32e-bb73-4797-9a14-a84d08d2c324 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:31.086473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:31.087210 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:31.087584 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:31.087984 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:31.142248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1633803-ed02-4cf5-baa8-9d8e38be6293 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:31.195791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d573e-40a5-4a21-82f6-6692cf12fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:31.197228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d573e-40a5-4a21-82f6-6692cf12fee5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:31.197508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d573e-40a5-4a21-82f6-6692cf12fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:31.197818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d573e-40a5-4a21-82f6-6692cf12fee5 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:31.198500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d573e-40a5-4a21-82f6-6692cf12fee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:31.198804 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d573e-40a5-4a21-82f6-6692cf12fee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:31.200237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d573e-40a5-4a21-82f6-6692cf12fee5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:31.205638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:31.218821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 382/752] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:31.220049 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ce354-88b1-4922-9b60-6e020ff6015b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:31.220690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ce354-88b1-4922-9b60-6e020ff6015b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:31.220690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ce354-88b1-4922-9b60-6e020ff6015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:31.227171 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:31.229983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:31.258593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fd2ce354-88b1-4922-9b60-6e020ff6015b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:31.259965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fd2ce354-88b1-4922-9b60-6e020ff6015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:31.319697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:31.382861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 371/753] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:33:31.383088 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 383/754] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:31.383088 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ce354-88b1-4922-9b60-6e020ff6015b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:31.384417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:31.517224 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ce354-88b1-4922-9b60-6e020ff6015b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:31.555030 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:31.567992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e5d4-5e21-47f6-9496-9f0d28fea424 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:31.572529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:31.573422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:31.573915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:31.574394 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:31.587748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:31.590261 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:31.612632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:31.613584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:31.614499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:31.615381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 384/755] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:31.623481 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:31.624271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:31.624647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:31.625012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:31.626448 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:31.654949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:31.658093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:31.715137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:31.717084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:31.718992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:31.718992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:31.718992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:31.724967 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 372/756] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:31.730091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:31.739043 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:31.843127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f14ed-f748-4082-bc1c-fbc2a3a78561 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:31.878708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:31.879350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:31.879617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:31.879891 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:31.880595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:31.880924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:31.883009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:31.901690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 385/757] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:31.901690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:31.925351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ac4e3-2f52-44d6-89fb-79f07a574dd2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:31.965546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:31.967254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:31.968493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:31.969784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:31.970639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:31.971949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:31.973523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:31.987603 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 373/758] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:31.988923 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:31.994365 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:32.020097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:32.031404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c85c9-98b5-4b33-aa7b-f66ea4d41870 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.075125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.077858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.077858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.077858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.089930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:32.095501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:32.096623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:32.097467 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:32.102451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 386/759] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:32.103501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:32.121695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fa29-8cf5-4d7e-9c87-3b9e13661854 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.162990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.164043 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.164544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.165299 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.166370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=04490cc2eef14514bc2834de17458744) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:32.166895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:32.168647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:32.181701 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 374/760] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:31 2022] GET /identity/v3/role_assignments?user.id=04490cc2eef14514bc2834de17458744&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:32.183058 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:32.229716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b144-175e-4860-9710-24b28db6c69e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.302532 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.303604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.304138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.305089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.311919 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:32.327515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:32.329165 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:32.356452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:32.357585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:32.358702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:32.360001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 387/761] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:32.369474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:32.388151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e1a7-cc14-4227-bbc8-3a7e4fc2195d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.388860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:32.440362 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.441066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.441355 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.441986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.442582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:32.442889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:32.444441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:32.465189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 375/762] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:32.479756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:32.511710 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ba818-64d4-47c6-aff9-8581e47e489d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.565847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.566879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.567369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.567854 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.568793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:32.569318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:32.571075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:32.584569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 388/763] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:32.593784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:32.639928 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e187-479d-4680-9b91-137a88af47f7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.675486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:32.686310 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:32.696604 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.697267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.697545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.697838 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.722000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:32.724671 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:32.752417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:32.753440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:32.754365 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:32.754365 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:32.754365 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:32.755059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 376/764] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:32.761431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:32.769091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9943-e4e3-48b6-94fe-db8251ff0909 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.887059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390f07-3183-409a-8dec-1d84b2ebd291 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:32.905931 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.907104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.908789 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.909501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.911255 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=6109aa049e0347bbae8c2e54235e66a0) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:32.912050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:32.916893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:32.927456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 389/765] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:32 2022] GET /identity/v3/role_assignments?user.id=6109aa049e0347bbae8c2e54235e66a0&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:32.941423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:32.942838 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:32.943320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:32.943819 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:32.944745 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:32.945767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:32.947427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:32.971165 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 377/766] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:32.974662 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:33.099636 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd07d0-3d67-4dcf-97d3-3f0e6e0070ae None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:33.143369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:33.144412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:33.144910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:33.145418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:33.149485 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:33.155712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:33.157565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:33.171876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:33.172908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:33.173910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:33.181524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 390/767] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:33:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:33.183346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:33.249767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:33.361177 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b2433-3628-49ba-902b-5ff19714fcae None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:33.430872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:33.431949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:33.432410 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:33.432867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:33.434225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:33.434762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:33.437361 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:33.463235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 378/768] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:33:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:33.469406 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:33.611312 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853733a2-c607-4655-83ba-18e865d74007 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:33.653519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5c22e-0f54-4d93-86b0-5fd3a2058904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:33.654206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c22e-0f54-4d93-86b0-5fd3a2058904 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:33.654488 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c22e-0f54-4d93-86b0-5fd3a2058904 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:33.654753 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c22e-0f54-4d93-86b0-5fd3a2058904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:33.667470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5c22e-0f54-4d93-86b0-5fd3a2058904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:33.668936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5c22e-0f54-4d93-86b0-5fd3a2058904 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1cf5c22e-0f54-4d93-86b0-5fd3a2058904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:33.684511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:33.686378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:33.688185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:33.688185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:33.688185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:33.688185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 391/769] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:33.694917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:33.784472 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790793a8-b0bc-49c5-b2c3-576311abe36b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:33.784903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790793a8-b0bc-49c5-b2c3-576311abe36b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:33.785208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790793a8-b0bc-49c5-b2c3-576311abe36b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:33.786779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 392/770] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:33:33.796667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949bce-1981-420a-a623-7962d949a356 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:33.797099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949bce-1981-420a-a623-7962d949a356 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:33.797342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949bce-1981-420a-a623-7962d949a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:33.828574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1a949bce-1981-420a-a623-7962d949a356 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:33.829837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1a949bce-1981-420a-a623-7962d949a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:33.850287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:33.854242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3ce74-132c-4597-b741-195df837a9ae None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:33.938461 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:33.941707 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:33.944153 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:33.944455 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:33.944784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:33.945621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:33.945871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:33.947350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:33.975585 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 379/771] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:33.982458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:33.999123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 393/772] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 22 02:33:34.127786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac74a4-fd4d-4c75-a411-764f415f0032 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:34.174063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:34.174709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:34.174987 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:34.175262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:34.182750 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:34.184219 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:34.196266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:34.197170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:34.198725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 380/773] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:34.203455 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a949bce-1981-420a-a623-7962d949a356 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:34.428453 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:34.438997 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a949bce-1981-420a-a623-7962d949a356 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:34.483671 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:34.524944 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:34.526401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:34.526910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:34.527385 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:34.528299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:34.528810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:34.530701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:34.564431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 394/774] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:34.573350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:34.619152 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:34.697535 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dcf98-e715-450d-b86f-3405dc73543d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:34.728405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9899e-eb5a-4a93-b6d6-277dcf8640fe None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:34.745359 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:34.746333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:34.746765 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:34.747191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/94bfeac1fea64803913036131d3bc6f5/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:34.749550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=94bfeac1fea64803913036131d3bc6f5, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:34.751274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:34.779357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 395/775] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:34 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/94bfeac1fea64803913036131d3bc6f5/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:33:34.805273 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0decdff-fd63-4f73-aaf4-f1a14b4e4643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:34.806282 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0decdff-fd63-4f73-aaf4-f1a14b4e4643 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:34.806739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0decdff-fd63-4f73-aaf4-f1a14b4e4643 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:34.807157 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0decdff-fd63-4f73-aaf4-f1a14b4e4643 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:34.807966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0decdff-fd63-4f73-aaf4-f1a14b4e4643 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:34.809552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0decdff-fd63-4f73-aaf4-f1a14b4e4643 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e0decdff-fd63-4f73-aaf4-f1a14b4e4643 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:34.826270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:34.827462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 02:33:34.828450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:34.835671 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 381/776] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Sep 22 02:33:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:34.837418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:34.952956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:34.960846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c852-2f74-4d62-8aaa-4222f0093ab5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:34.972545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c98a7-76b9-4210-93dd-4e9fda916424 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:34.973094 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c98a7-76b9-4210-93dd-4e9fda916424 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:34.973507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c98a7-76b9-4210-93dd-4e9fda916424 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:34.986273 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 382/777] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:34 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:33:34.995441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879884c9-63b5-469b-81c1-0d915ce4e550 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:34.995849 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879884c9-63b5-469b-81c1-0d915ce4e550 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:34.996343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879884c9-63b5-469b-81c1-0d915ce4e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:35.003698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:35.004566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:35.005022 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:35.005443 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:35.006278 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:35.006729 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:35.008413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:35.017811 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 396/778] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 22 02:33:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:35.020805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:35.079574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-879884c9-63b5-469b-81c1-0d915ce4e550 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:35.081507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-879884c9-63b5-469b-81c1-0d915ce4e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:35.141358 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27f72f-22dd-4418-9d90-2ebe477be560 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:35.182659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:35.183568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:35.184005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:35.184428 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:35.185228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:35.185720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:35.187308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:35.194393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 397/779] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 22 02:33:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:35.200440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:35.233389 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:35.274359 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 383/780] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:33:35.316943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0bc7-be53-473e-8c64-9c1d68804892 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:35.354718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:35.355662 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:35.356125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:35.356603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:35.357476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:35.359061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:35.392910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 398/781] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:33:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:33:35.858553 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879884c9-63b5-469b-81c1-0d915ce4e550 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:35.888646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:36.091683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879884c9-63b5-469b-81c1-0d915ce4e550 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:36.203390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b341db-dda7-4d25-b82a-6cca6b716e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:36.204438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b341db-dda7-4d25-b82a-6cca6b716e70 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:36.204915 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b341db-dda7-4d25-b82a-6cca6b716e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:36.205378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b341db-dda7-4d25-b82a-6cca6b716e70 None admin] PATH_INFO: `/v3/services/network` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:36.206467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b341db-dda7-4d25-b82a-6cca6b716e70 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:36.209083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b341db-dda7-4d25-b82a-6cca6b716e70 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-08b341db-dda7-4d25-b82a-6cca6b716e70 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:36.230462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:36.232526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:36.235305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 384/782] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:35 2022] GET /identity/v3/services/network => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:36.241713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:36.294022 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc316766-177e-4625-b0b1-721566684430 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:36.294500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc316766-177e-4625-b0b1-721566684430 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:36.294971 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc316766-177e-4625-b0b1-721566684430 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:36.298102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 385/783] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:36.305368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acc73f-c946-47c5-84ee-9ea41cf4ee44 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:36.305871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acc73f-c946-47c5-84ee-9ea41cf4ee44 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:36.306346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acc73f-c946-47c5-84ee-9ea41cf4ee44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:36.366148 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-44acc73f-c946-47c5-84ee-9ea41cf4ee44 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:36.368323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-44acc73f-c946-47c5-84ee-9ea41cf4ee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:36.452108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:36.519690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5bf63-f146-45c6-894b-ff44c6ff7379 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:36.536328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 386/784] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:33:36.588341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:36.589362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:36.589899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:36.590386 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:36.591540 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] RBAC: Adding query filter params (name=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:36.592072 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:36.594691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:36.604081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 399/785] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:33:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:36.610321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acc73f-c946-47c5-84ee-9ea41cf4ee44 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:36.633478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:36.864448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acc73f-c946-47c5-84ee-9ea41cf4ee44 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:36.930594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:36.932003 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:36.932705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:36.933371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:36.934858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] RBAC: Adding query filter params (type=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:36.935632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:36.938645 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:36.948463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 387/786] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:33:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:36.957700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:37.170455 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:37.186777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bbb6-65cf-4a9e-9a82-0f009d21d0cd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:37.303204 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:37.304250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:37.304695 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:37.305176 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:37.306474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] RBAC: Adding query filter params (interface=public, service_id=2a540b0e64fd4b8b9becd6f49b69f5c9, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:37.307009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:37.309540 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:37.343325 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 400/787] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:33:36 2022] GET /identity/v3/endpoints?service_id=2a540b0e64fd4b8b9becd6f49b69f5c9&interface=public®ion_id=RegionOne => generated 194 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:37.351956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:37.358819 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:37.401140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3c430-d258-4477-8a42-42ed7d298595 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:37.410223 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:37.511670 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088f979-94fc-473b-9e0d-1c0aa0e40049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:37.511995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f979-94fc-473b-9e0d-1c0aa0e40049 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:37.512365 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f979-94fc-473b-9e0d-1c0aa0e40049 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:37.512529 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f979-94fc-473b-9e0d-1c0aa0e40049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:37.545212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088f979-94fc-473b-9e0d-1c0aa0e40049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e088f979-94fc-473b-9e0d-1c0aa0e40049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:37.573693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:37.575493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 388/788] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:37.577145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0ac7-8dee-4db0-bcc4-d37a0c8e8be3 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:37.591404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0ac7-8dee-4db0-bcc4-d37a0c8e8be3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:37.591404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0ac7-8dee-4db0-bcc4-d37a0c8e8be3 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:37.591404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 389/789] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:37 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:37.611597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0ac7-8dee-4db0-bcc4-d37a0c8e8be3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:37.693350 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73bb07-8e98-467e-a0d9-361618cabc3a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:37.774484 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d1ac3-4583-481f-b3a3-219bf3dc87a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:37.775412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d1ac3-4583-481f-b3a3-219bf3dc87a2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:37.776031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d1ac3-4583-481f-b3a3-219bf3dc87a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:37.776517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d1ac3-4583-481f-b3a3-219bf3dc87a2 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:37.777621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d1ac3-4583-481f-b3a3-219bf3dc87a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:37.780571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d1ac3-4583-481f-b3a3-219bf3dc87a2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:37.801590 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 401/790] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:33:37 2022] GET /identity/v3/services => generated 772 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:37.804052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc7a8-ef17-4cc6-a5ae-16972b6ecc29 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:37.804585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc7a8-ef17-4cc6-a5ae-16972b6ecc29 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:37.805091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc7a8-ef17-4cc6-a5ae-16972b6ecc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:37.847525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-427bc7a8-ef17-4cc6-a5ae-16972b6ecc29 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:37.848772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-427bc7a8-ef17-4cc6-a5ae-16972b6ecc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:37.857694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0ac7-8dee-4db0-bcc4-d37a0c8e8be3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:37.913284 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:37.929696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d939-14c9-45a0-8e5d-ec6931ec771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:37.933686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d939-14c9-45a0-8e5d-ec6931ec771e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:37.933686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d939-14c9-45a0-8e5d-ec6931ec771e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:37.933686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d939-14c9-45a0-8e5d-ec6931ec771e None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:37.933686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d939-14c9-45a0-8e5d-ec6931ec771e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:37.933686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d939-14c9-45a0-8e5d-ec6931ec771e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:37.937683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d939-14c9-45a0-8e5d-ec6931ec771e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:37.959435 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 390/791] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:37.961344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba997-80b0-4f23-a0f4-de5ef6db0b52 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:37.961864 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba997-80b0-4f23-a0f4-de5ef6db0b52 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:37.962357 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba997-80b0-4f23-a0f4-de5ef6db0b52 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:37.965443 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 391/792] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:37.966749 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fba997-80b0-4f23-a0f4-de5ef6db0b52 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:38.106066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 402/793] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:38.106066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24295-6d51-4e3a-a1ef-8acc1760e1ad None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:38.106459 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24295-6d51-4e3a-a1ef-8acc1760e1ad None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:38.106712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24295-6d51-4e3a-a1ef-8acc1760e1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:38.121008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:38.140019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-21d24295-6d51-4e3a-a1ef-8acc1760e1ad None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:38.143052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-21d24295-6d51-4e3a-a1ef-8acc1760e1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:38.283516 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fba997-80b0-4f23-a0f4-de5ef6db0b52 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:38.349746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 403/794] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:38.431439 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:38.432533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:38.433013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:38.433476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:38.461173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:38.464179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:38.494828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:38.495847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:38.496731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:38.496731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:38.496731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:38.501809 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 392/795] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 531 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:38.507488 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24295-6d51-4e3a-a1ef-8acc1760e1ad None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:38.667526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:38.765091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24295-6d51-4e3a-a1ef-8acc1760e1ad None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:38.778220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:38.840400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:38.841840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:38.842613 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:38.843473 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:38.844896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:38.845827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:38.849062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:38.849699 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9e586-e81b-443c-bb6b-c6937340cca9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:38.852944 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:38.884976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 404/796] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:38.887448 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:38.891591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:38.892326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:38.892652 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:38.892995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:38.905687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:38.911146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:38.913646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 393/797] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:38.915631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:39.055368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6229fc-6eac-4fa8-9e00-db2642fea477 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:39.131305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:39.132983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:39.133921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:39.134680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:39.157585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:39.169530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:39.171400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:39.173059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:39.177990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 405/798] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:39.180626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:39.276498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c6be-98e0-4a5b-b3bb-26aab517b96e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:39.282542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:39.318552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:39.359034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:39.361095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:39.361895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:39.362637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:39.379787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:39.384238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:39.412758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:39.415369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:39.417214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:39.426255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 394/799] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 506 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:39.426255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:39.431650 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaf64a-6ce9-4e62-8ba7-94326c4ebae4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:39.508071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:39.509738 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:39.510591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:39.511362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:39.512959 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:39.513898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:39.517010 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:39.535040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 406/800] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:39.537068 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:39.642085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b329a2-859e-44df-842e-e13620f35c93 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:39.700103 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:39.701141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:39.701631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:39.702144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:39.703325 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:39.703848 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:39.706422 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:39.727618 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 395/801] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:39.727618 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:39.735008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a1c6d-8143-4f44-9329-2e8ecf2b3f0b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:39.768526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:39.768768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:39.804508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779670-63f9-4182-9680-fcbd508d00f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:39.805536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779670-63f9-4182-9680-fcbd508d00f5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:39.806037 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779670-63f9-4182-9680-fcbd508d00f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:39.806522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779670-63f9-4182-9680-fcbd508d00f5 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:39.807892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37779670-63f9-4182-9680-fcbd508d00f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:39.808436 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37779670-63f9-4182-9680-fcbd508d00f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:39.811264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37779670-63f9-4182-9680-fcbd508d00f5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:39.842130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 407/802] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 22 02:33:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:39.844250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b6e7-783c-4c78-8463-1eb38a97f504 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:39.844662 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b6e7-783c-4c78-8463-1eb38a97f504 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:39.845044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b6e7-783c-4c78-8463-1eb38a97f504 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:39.851260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 408/803] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:39.851260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9b6e7-783c-4c78-8463-1eb38a97f504 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:39.890347 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189ed5-b528-4d1c-987f-f390b0057440 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:39.937156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:39.938354 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:39.938767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:39.939173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:39.957573 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:39.959470 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:39.978587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:39.980712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:39.982778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:39.982778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:39.982778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:39.983501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 396/804] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:39.985413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.032705 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9b6e7-783c-4c78-8463-1eb38a97f504 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:40.087541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3629c0-45d1-4d73-acc0-dfa685e1d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:40.088183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3629c0-45d1-4d73-acc0-dfa685e1d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.088556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3629c0-45d1-4d73-acc0-dfa685e1d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.088806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:40.088960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3629c0-45d1-4d73-acc0-dfa685e1d1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.110103 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3629c0-45d1-4d73-acc0-dfa685e1d1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:40.112853 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3629c0-45d1-4d73-acc0-dfa685e1d1f6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:40.121331 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247f667-f34a-4eff-9932-db0dd196ce41 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9c3629c0-45d1-4d73-acc0-dfa685e1d1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:40.142659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:40.144508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:40.154899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:40.154899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:40.154899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:40.154899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 409/805] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:40.154899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39a34a-4489-499a-ac8d-ad197ebe4a1d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.154899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39a34a-4489-499a-ac8d-ad197ebe4a1d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.154899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39a34a-4489-499a-ac8d-ad197ebe4a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.176168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:40.176932 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.177374 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.177535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.182858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0d39a34a-4489-499a-ac8d-ad197ebe4a1d None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:40.184895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0d39a34a-4489-499a-ac8d-ad197ebe4a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:40.192323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:40.194884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:40.220167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:40.222226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:40.224614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:40.224614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:40.224614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:40.226194 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 397/806] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:40.227513 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:40.229517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.296356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 410/807] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:40.297401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39a34a-4489-499a-ac8d-ad197ebe4a1d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.429413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e403-bde2-4df9-b765-96f1ee29c6a8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:40.445556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39a34a-4489-499a-ac8d-ad197ebe4a1d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:40.462918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:40.472599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:40.473765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.474049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.474321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.475030 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:40.475301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:40.476702 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:40.490683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 398/808] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:40.491258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.493859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75678de-dce5-409e-8072-d3cb4da7b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:40.496998 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75678de-dce5-409e-8072-d3cb4da7b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.497990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75678de-dce5-409e-8072-d3cb4da7b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.498556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75678de-dce5-409e-8072-d3cb4da7b0a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.499568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75678de-dce5-409e-8072-d3cb4da7b0a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:40.500114 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75678de-dce5-409e-8072-d3cb4da7b0a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:40.502762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75678de-dce5-409e-8072-d3cb4da7b0a5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:40.520076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 411/809] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:40.522248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc671f-916b-4dfd-b5f1-37e847e96aa1 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.523070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc671f-916b-4dfd-b5f1-37e847e96aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.523827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc671f-916b-4dfd-b5f1-37e847e96aa1 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.525875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 412/810] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:40.527505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc671f-916b-4dfd-b5f1-37e847e96aa1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.551642 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:40.644194 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efceb0-88d8-4a6b-8c73-f678ca2c1b4c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:40.684575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc671f-916b-4dfd-b5f1-37e847e96aa1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:40.700839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:40.701955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.702471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.702998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.704099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:40.704515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:40.706128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:40.726896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 399/811] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:40.728391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.729376 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92184cae-a7bf-4997-a445-48ad7a267a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:40.730054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92184cae-a7bf-4997-a445-48ad7a267a01 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.730332 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92184cae-a7bf-4997-a445-48ad7a267a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.730604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92184cae-a7bf-4997-a445-48ad7a267a01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.739348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92184cae-a7bf-4997-a445-48ad7a267a01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:40.740878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92184cae-a7bf-4997-a445-48ad7a267a01 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-92184cae-a7bf-4997-a445-48ad7a267a01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:40.754381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:40.755597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:40.756619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 413/812] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:33:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:40.757275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfdcc8-8e5f-4858-b3ee-640319014ecd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.757355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfdcc8-8e5f-4858-b3ee-640319014ecd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.757644 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfdcc8-8e5f-4858-b3ee-640319014ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.776767 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-94cfdcc8-8e5f-4858-b3ee-640319014ecd None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:40.778045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-94cfdcc8-8e5f-4858-b3ee-640319014ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:40.799575 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:40.852237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 414/813] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:40.853253 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfdcc8-8e5f-4858-b3ee-640319014ecd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.862112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb23af-c961-425d-a715-91230c7ab3e5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:40.866627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:40.908454 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:40.909386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:40.909824 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:40.910311 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:40.923577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:40.926424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:40.947475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:40.948489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:33:40.949450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:40.956453 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 400/814] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:33:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:40.957999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:40.993024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfdcc8-8e5f-4858-b3ee-640319014ecd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.040629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.040966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.041171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.041437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.042066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.043450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:41.054740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:41.056678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:41.058304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 415/815] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:41.059875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.119761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea979-b091-4565-aac9-a2d05ba80b5e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.131146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:41.153622 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:41.162191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.162468 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.162590 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.162864 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.170910 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.172406 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.188750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e138027-2318-4e48-8127-f9b9c318b0f5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:41.193533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:41.195248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 401/816] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:41.202673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.229612 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.230252 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.230531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.230813 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.231550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:41.231860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.233299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.251711 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 416/817] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:41.252571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.326027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609d52-ef55-476d-9f83-2f8dc7c96859 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.381209 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246069ef-ead0-41f5-adf6-5e1f2a1e919a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.381877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.382968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.383440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.383792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.385102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:41.385639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.388250 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.412735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:41.426610 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 402/818] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:41.426900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.427067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.427246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.427246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.427246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.427246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:41.427246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.427246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.432543 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 417/819] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:41.433405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.470152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:41.564007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7491-9948-40b4-905d-f0b99172018a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.583627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029704f-4816-4acc-90dc-dc01aad6838f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.614200 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.614817 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.615100 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.615374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.616080 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:41.616950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.618440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.636232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 418/820] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:41.636455 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.637407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.637523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.637883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.638304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] PATH_INFO: `/v3/services/network` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.639281 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.641712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:41.656739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:41.658077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:41.659059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 403/821] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:41.660391 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.711401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:41.773627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:41.773854 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbbb09-ab85-483b-8a23-0bb4923b6b19 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.785746 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a1435-0ec9-4521-9e7a-d460170acd17 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.812051 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.812699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.812969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.813247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.825044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.826511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.827446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:41.828060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:41.828348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:41.828627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:41.842982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:41.844034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:41.844916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:41.844916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:41.844916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:41.844916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 419/822] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:41.844916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:41.909390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:41.910887 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:41.965520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c72ed-4671-4e8b-87db-daed8b237733 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:41.967888 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:42.013509 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:42.014213 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:42.014492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:42.014762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:42.015435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:42.015736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:42.017219 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:42.023215 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 420/823] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:42.024282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:42.040969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:42.065047 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 404/824] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:33:42.066906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:42.211437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca183e2-4adc-4bb7-ab48-de6d3232d156 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:42.240775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfa84-f266-4ae9-b013-6b35f1d59ed1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:42.263848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:42.264787 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:42.265066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:42.265346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/04490cc2eef14514bc2834de17458744/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:42.267825 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=04490cc2eef14514bc2834de17458744, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:42.269281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:42.285602 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 421/825] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:42 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/04490cc2eef14514bc2834de17458744/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:33:42.286359 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:42.291086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:42.291715 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:42.291995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:42.292263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:42.292928 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] RBAC: Adding query filter params (name=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:42.293230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:42.294694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:42.300081 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 405/826] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:33:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:42.300946 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:42.342351 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:42.399095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:42.483811 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34060ff-0ee5-4c86-a103-034ad5781f14 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:42.488863 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455d9b8-a7af-4fcd-96ac-c0c7521e7ba1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:42.549166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:42.550349 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:42.550699 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:42.551144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:42.558755 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:42.559779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:42.560263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:42.560739 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:42.561929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:42.562468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:42.565383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:42.575372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:42.575372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:42.590450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 422/827] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:42.592059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:42.601632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:42.602669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:42.603542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:42.603542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:42.603542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:42.604125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 406/828] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:42.605389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:42.767374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:42.797692 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea15d-c7ef-4d93-9286-7fe50d08a1fc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:42.799129 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b274-f8ef-43f4-971a-574a6406f564 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:42.809977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:42.854937 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:42.856318 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:42.856742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:42.857153 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:42.864864 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:42.865688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:42.866153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:42.867031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:42.867776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] RBAC: Adding query filter params (type=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:42.868153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:42.869672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:42.869840 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:42.873232 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:42.876140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 423/829] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:33:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:42.877213 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:42.893548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:42.895348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:42.897007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:42.898657 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 407/830] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:42.905691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:43.024738 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f0ca5-b464-4a3c-b1b0-66f6560c7d3b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:43.027040 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f92c3-f00c-4c27-8214-2179e63ddf66 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:43.070052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:43.070595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:43.070878 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:43.071154 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:43.071806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:43.072112 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:43.073485 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:43.075909 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:43.076539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:43.076813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:43.077081 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:43.077798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:43.079798 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:43.096287 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 424/831] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:43.096287 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:43.110317 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 408/832] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:33:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:33:43.111232 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:43.119263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:43.148262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:43.329115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0f27e-fab6-4c6e-b118-16f6b24a6de2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:43.329390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7a12f-1544-41bf-aa3b-8bb1b35f6d90 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:43.372105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a481238-987a-4928-8505-15318145951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:43.372767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481238-987a-4928-8505-15318145951c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:43.373045 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481238-987a-4928-8505-15318145951c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:43.373323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481238-987a-4928-8505-15318145951c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:43.393430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a481238-987a-4928-8505-15318145951c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:43.399267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a481238-987a-4928-8505-15318145951c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6a481238-987a-4928-8505-15318145951c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:43.423010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:43.424807 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:43.427554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 409/833] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:43.433691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:43.433691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:43.433691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:43.433691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:43.434617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:43.434617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:43.435013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a481238-987a-4928-8505-15318145951c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:43.435989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:43.452330 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 425/834] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:43.458837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:43.590170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:43.610619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:43.654939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a481238-987a-4928-8505-15318145951c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:43.674566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f9d-f047-4564-a165-f907b8b71c7d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:43.716614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:43.717343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:43.717712 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:43.718056 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:43.718851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:43.719224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:43.720768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:43.743189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 410/835] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:43.749308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:43.754884 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee699-a5a7-4ea2-b5c6-426e56d0b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:43.756464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee699-a5a7-4ea2-b5c6-426e56d0b2aa None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:43.757223 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee699-a5a7-4ea2-b5c6-426e56d0b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:43.757939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee699-a5a7-4ea2-b5c6-426e56d0b2aa None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/6109aa049e0347bbae8c2e54235e66a0/roles/04e96ff01f0a484ba43803759e6eabe9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:43.794057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee699-a5a7-4ea2-b5c6-426e56d0b2aa None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=6109aa049e0347bbae8c2e54235e66a0, role_id=04e96ff01f0a484ba43803759e6eabe9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:43.798566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee699-a5a7-4ea2-b5c6-426e56d0b2aa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:43.833626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 426/836] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:33:43 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/6109aa049e0347bbae8c2e54235e66a0/roles/04e96ff01f0a484ba43803759e6eabe9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:33:43.940376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426d9d5-ec32-49f4-a93f-9cda3c575172 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:44.013485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4abdd-ffca-4c15-bdae-ad192dd933f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:44.014601 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4abdd-ffca-4c15-bdae-ad192dd933f1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:44.015083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4abdd-ffca-4c15-bdae-ad192dd933f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:44.015561 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4abdd-ffca-4c15-bdae-ad192dd933f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:44.016953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4abdd-ffca-4c15-bdae-ad192dd933f1 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=94bfeac1fea64803913036131d3bc6f5) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:44.017488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4abdd-ffca-4c15-bdae-ad192dd933f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:44.020253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4abdd-ffca-4c15-bdae-ad192dd933f1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:44.033211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 411/837] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:43 2022] GET /identity/v3/role_assignments?user.id=94bfeac1fea64803913036131d3bc6f5&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:45.261289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c17ddc-41c4-4858-a4ac-82f1590d8577 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:45.261912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c17ddc-41c4-4858-a4ac-82f1590d8577 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:45.262385 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c17ddc-41c4-4858-a4ac-82f1590d8577 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:45.265941 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 427/838] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:45.275640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ce8d-d7f1-418c-a2a6-f5c9c45d6604 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:45.276179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ce8d-d7f1-418c-a2a6-f5c9c45d6604 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:45.276597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ce8d-d7f1-418c-a2a6-f5c9c45d6604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:45.287784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:45.311119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-85d1ce8d-d7f1-418c-a2a6-f5c9c45d6604 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:45.313096 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-85d1ce8d-d7f1-418c-a2a6-f5c9c45d6604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:45.448368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 412/839] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:45.728919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c17ddc-41c4-4858-a4ac-82f1590d8577 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:45.813631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15344f-d810-447a-a01c-e0b720f4af42 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:45.814025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15344f-d810-447a-a01c-e0b720f4af42 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:45.814215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15344f-d810-447a-a01c-e0b720f4af42 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:45.815853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 413/840] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:45.821640 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ebff-945e-4bd7-bb81-2edfd15ac540 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:45.821982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ebff-945e-4bd7-bb81-2edfd15ac540 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:45.822208 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ebff-945e-4bd7-bb81-2edfd15ac540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:45.859014 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4b32ebff-945e-4bd7-bb81-2edfd15ac540 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:45.862329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4b32ebff-945e-4bd7-bb81-2edfd15ac540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:45.887390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c17ddc-41c4-4858-a4ac-82f1590d8577 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:45.918812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:45.936763 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607ccd2-b783-4a7b-8970-2e587d9b57e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:45.937938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607ccd2-b783-4a7b-8970-2e587d9b57e5 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:45.938316 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607ccd2-b783-4a7b-8970-2e587d9b57e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:45.938846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607ccd2-b783-4a7b-8970-2e587d9b57e5 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:45.939645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607ccd2-b783-4a7b-8970-2e587d9b57e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:45.941012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607ccd2-b783-4a7b-8970-2e587d9b57e5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:45.966710 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 428/841] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:33:45 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:33:46.010988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 414/842] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:33:46.274381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1cf7-abbc-4232-ab9f-d69890bbcfa5 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:46.275079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1cf7-abbc-4232-ab9f-d69890bbcfa5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:46.275079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1cf7-abbc-4232-ab9f-d69890bbcfa5 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:46.276637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 429/843] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:46.282743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed58f0-df0c-470b-b441-1f538d863ce5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:46.283396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed58f0-df0c-470b-b441-1f538d863ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:46.283396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed58f0-df0c-470b-b441-1f538d863ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:46.304302 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e7ed58f0-df0c-470b-b441-1f538d863ce5 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:46.305515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e7ed58f0-df0c-470b-b441-1f538d863ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:46.343650 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1cf7-abbc-4232-ab9f-d69890bbcfa5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:46.368995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:46.387237 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 415/844] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:46.552249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1cf7-abbc-4232-ab9f-d69890bbcfa5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:46.622744 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:46.625275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:46.626003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:46.626503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:46.650595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:46.660745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:46.661890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:33:46.662718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:46.663898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 430/845] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:46.665437 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed58f0-df0c-470b-b441-1f538d863ce5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:46.673870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:46.730299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:46.794477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263221-1af7-46bb-8d26-15e426767570 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:46.839302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4f1c6-6d68-46da-8d05-9b03e2f78b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:46.839817 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4f1c6-6d68-46da-8d05-9b03e2f78b88 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:46.840093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4f1c6-6d68-46da-8d05-9b03e2f78b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:46.840362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4f1c6-6d68-46da-8d05-9b03e2f78b88 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:46.841039 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4f1c6-6d68-46da-8d05-9b03e2f78b88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:46.841349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4f1c6-6d68-46da-8d05-9b03e2f78b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:46.842866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4f1c6-6d68-46da-8d05-9b03e2f78b88 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:46.852697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 431/846] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:33:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:46.853833 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609c38-ddb3-4f38-a148-8753e2554d83 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:46.854117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609c38-ddb3-4f38-a148-8753e2554d83 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:46.854384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609c38-ddb3-4f38-a148-8753e2554d83 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:46.854748 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed58f0-df0c-470b-b441-1f538d863ce5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:46.859703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 432/847] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:46.861183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b6ba4-de74-4673-aa1b-4f4e3e68df2c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:46.861460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b6ba4-de74-4673-aa1b-4f4e3e68df2c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:46.861771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b6ba4-de74-4673-aa1b-4f4e3e68df2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:46.887786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e36b6ba4-de74-4673-aa1b-4f4e3e68df2c None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:46.890017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e36b6ba4-de74-4673-aa1b-4f4e3e68df2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:46.901020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:46.901687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:46.901965 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:46.902234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:46.915301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:46.920098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:46.921119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:46.921981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 416/848] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:33:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:46.922668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:46.983168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:47.016236 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 433/849] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:47.017952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b6ba4-de74-4673-aa1b-4f4e3e68df2c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:47.069796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1920df-22e9-4b14-83dd-aa387207495a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:47.075696 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:47.131454 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:47.132765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:47.133250 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:47.133781 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:47.155995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:47.158970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:47.167010 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b6ba4-de74-4673-aa1b-4f4e3e68df2c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:47.186498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:47.187517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:47.188387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:47.188387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:47.188387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:47.194494 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 417/850] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:47.199018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:47.372760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:47.377419 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe43c3-903a-43ca-99ef-caa2dfcd5b2f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:47.387975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:47.388988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:47.389478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:47.390101 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:47.391533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:47.392081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:47.394905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:47.413707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 434/851] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:47.413707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:47.425315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:47.425976 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:47.426322 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:47.426602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:47.427261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:47.427562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:47.429057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:47.442883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 418/852] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:47.443639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:47.544760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:47.554458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577d2d4-ece4-47b5-aa7d-0d0403724a12 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:47.577612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af7cb-38db-41ab-a324-684c395f6cb7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:47.603404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:47.604474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:47.604987 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:47.605480 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:47.606529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:47.608992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:47.625995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:47.626984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:47.627868 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:47.629276 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 435/853] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:47.630657 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:47.650115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:47.651188 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:47.651747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:47.652698 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:47.666676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:47.668155 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:47.701017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:47.702896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:47.704718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:47.704718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:47.704718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:47.704718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 419/854] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:47.706317 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:47.735411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:47.784800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b060dc8-6d39-440c-a806-fbd577831afd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:47.848418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:47.849494 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:47.850013 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:47.850536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] PATH_INFO: `/v3/users/swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:47.865843 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:47.869424 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:47.887143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09b31-1ec3-4a40-863d-cf46f1bdbf0d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:47.893046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:47.895477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 02:33:47.897334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:47.900549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 436/855] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:47.901514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:47.927399 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:47.935620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:47.936237 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:47.936514 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:47.936844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:47.937489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:47.937864 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:47.939248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:47.944142 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 420/856] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:47.945023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:48.043009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e4dd7-6b20-48bc-972a-4da80b317cba None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:48.077642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:48.102425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:48.103382 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.103832 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.104265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.105378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:48.105921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:48.108052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:48.123101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f8c38-2544-4f5d-ba44-37e0da9e2039 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:48.128070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 437/857] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:48.129856 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:48.184716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:48.185460 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.185959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.186420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.187655 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:48.188173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:48.190840 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:48.224287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 421/858] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 22 02:33:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:48.225436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:48.284825 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:48.312202 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02ad6-8ded-45a8-88e8-f37e908a921a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:48.354138 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fa7c6-4dfa-47b7-b14d-11bf15fa6320 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:48.357505 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:48.358577 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.359006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.359422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.360247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:48.360696 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:48.362561 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:48.377712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 438/859] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:33:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:48.377712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:48.423556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:48.424943 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.425509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.426148 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.430602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:48.444337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:48.446930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:48.473166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:48.475130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:48.477487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:48.489072 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 422/860] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:33:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:48.491054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:48.591410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21fd92-ec4c-4562-90aa-c859d7ee1c86 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:48.652549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4e915-557b-44a9-a898-ff3cee2120d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:48.652549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e915-557b-44a9-a898-ff3cee2120d7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.652549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e915-557b-44a9-a898-ff3cee2120d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.652549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e915-557b-44a9-a898-ff3cee2120d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.680848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:48.683066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77ef7c-b873-4d3e-a0b2-0b6d41e89eb4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:48.734087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea8e8-43f6-4326-a6da-112d7b793def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:48.734974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea8e8-43f6-4326-a6da-112d7b793def None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.735242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea8e8-43f6-4326-a6da-112d7b793def None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.735516 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea8e8-43f6-4326-a6da-112d7b793def None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.736256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea8e8-43f6-4326-a6da-112d7b793def None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:48.736557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea8e8-43f6-4326-a6da-112d7b793def None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:48.738035 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea8e8-43f6-4326-a6da-112d7b793def None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:48.758838 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 423/861] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 22 02:33:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:48.760195 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba855-ad17-4a07-a6d0-040fcbbee758 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.760483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba855-ad17-4a07-a6d0-040fcbbee758 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.760753 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba855-ad17-4a07-a6d0-040fcbbee758 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.762276 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 424/862] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:48.767387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dba855-ad17-4a07-a6d0-040fcbbee758 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:48.786216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4e915-557b-44a9-a898-ff3cee2120d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:48.788464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4e915-557b-44a9-a898-ff3cee2120d7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:48.834417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:48.895369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dba855-ad17-4a07-a6d0-040fcbbee758 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:48.903552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 439/863] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:48 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:33:48.904578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8980-262c-4d57-9330-06269e9c05c2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.904863 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8980-262c-4d57-9330-06269e9c05c2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.905130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8980-262c-4d57-9330-06269e9c05c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.925335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-976c8980-262c-4d57-9330-06269e9c05c2 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:48.926626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-976c8980-262c-4d57-9330-06269e9c05c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:48.945785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:48.946600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:48.947129 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:48.947597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:48.979848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:49.026137 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 440/864] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:49.026137 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8980-262c-4d57-9330-06269e9c05c2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:49.077945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:49.082337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:49.162016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8980-262c-4d57-9330-06269e9c05c2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:49.226212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:49.231698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:49.232890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:49.233464 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:49.234066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:49.254098 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:49.257635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:49.286834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:49.289020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:49.291372 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:49.291372 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:49.291372 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:49.293879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 441/865] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:49.302431 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:49.315970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 425/866] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:48 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:33:49.327902 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:49.360508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:49.514430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85651e40-61a7-4b4e-9380-1d9ea933001d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:49.533559 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57bc40-01a8-478a-bd1e-32ca0af0aec6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:49.587810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:49.588771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:49.589269 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:49.589798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:49.590995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:49.591552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:49.593839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:49.594084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:49.594483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:49.594765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:49.595019 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:49.609154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:49.610658 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:49.622090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 442/867] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:49.622090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:49.641415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:49.651465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:49.654174 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:49.654174 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:49.654174 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:49.654174 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 426/868] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:49.654174 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:49.656200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:49.781711 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9423f-d49f-490a-ada0-f5131ddecccb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:49.805222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:49.826265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680803d0-141a-4134-b4cc-815d9d32d3fd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:49.840251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:49.840780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:49.841180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:49.841344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:49.849173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:49.851206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:49.863506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:49.865112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 427/869] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:49.866718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:49.900672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:49.902242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:49.902744 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:49.903712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:49.904308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:49.907034 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:49.926645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:49.929185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:49.932653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 443/870] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:49.935906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:49.961681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:50.034728 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63769d3-7629-4ae6-92f6-ef059a4bfe75 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.082209 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.083070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.083505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.083945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.085493 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:50.085970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.087920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:50.103978 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 428/871] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:50.105410 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:50.124209 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ad8e-2519-48cb-9b21-8f8d56ad256c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.180554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.181309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.181682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.182016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.182819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:50.183192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.184701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:50.206568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 444/872] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:50.206568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:50.221708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:50.283079 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a698c48-e67b-44e7-a077-aa02d5e3061a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.330440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:50.350019 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.351081 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.351572 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.352052 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.353193 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:50.353769 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.356485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:50.365178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 429/873] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:50.366766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:50.384187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d74ec-d2e6-4c6f-8e84-a089b9bfba44 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.449845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.450831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.451277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.451615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.464043 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.466354 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:50.484384 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:50.486495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:50.488398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:50.492622 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 445/874] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:50.494246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:50.529361 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f7fa-cbef-4996-863a-8a8ebfdb3fbb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.595554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.596495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.596495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.596858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.597690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=04490cc2eef14514bc2834de17458744) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:50.598070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.599754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:50.606272 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 430/875] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:50 2022] GET /identity/v3/role_assignments?user.id=04490cc2eef14514bc2834de17458744&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:50.607181 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:50.619130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:50.685927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f011-9bda-43c2-aadf-298dab0ae669 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.721858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:50.761860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.762832 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.763308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.764368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.766238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:50.766756 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.769215 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:50.778619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 446/876] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:50.784329 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:50.826812 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aed697-baab-467f-82db-80a01e94e691 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.871095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80bc70-e5e3-4020-82b3-6f9b2a3037e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.871662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80bc70-e5e3-4020-82b3-6f9b2a3037e2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.871908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80bc70-e5e3-4020-82b3-6f9b2a3037e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.872171 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80bc70-e5e3-4020-82b3-6f9b2a3037e2 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.872874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80bc70-e5e3-4020-82b3-6f9b2a3037e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:50.873173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80bc70-e5e3-4020-82b3-6f9b2a3037e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.874671 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80bc70-e5e3-4020-82b3-6f9b2a3037e2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:50.890870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 431/877] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:50.892946 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c98ba-8c9d-486f-8f62-94d0fed62bf8 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.893273 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c98ba-8c9d-486f-8f62-94d0fed62bf8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.893574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c98ba-8c9d-486f-8f62-94d0fed62bf8 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.894977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 432/878] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:50.897410 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c98ba-8c9d-486f-8f62-94d0fed62bf8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:50.953205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32bb93-bbdd-4faa-b689-0d402b464e1f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:50.996134 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa6411-8aa6-4ebc-b0e2-3b8ec7b1c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:50.996772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6411-8aa6-4ebc-b0e2-3b8ec7b1c810 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:50.997083 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6411-8aa6-4ebc-b0e2-3b8ec7b1c810 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:50.997342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6411-8aa6-4ebc-b0e2-3b8ec7b1c810 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:50.998355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6411-8aa6-4ebc-b0e2-3b8ec7b1c810 None admin] RBAC: Adding query filter params (interface=public, service_id=bd184b9f2bd44e819917174a15aa7d3a, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:50.998355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6411-8aa6-4ebc-b0e2-3b8ec7b1c810 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:50.999711 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6411-8aa6-4ebc-b0e2-3b8ec7b1c810 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:51.001946 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:51.012637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 447/879] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:33:50 2022] GET /identity/v3/endpoints?service_id=bd184b9f2bd44e819917174a15aa7d3a&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:51.014327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6f16-3aaf-47b1-a6e7-fa51eea82ff6 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:51.014618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6f16-3aaf-47b1-a6e7-fa51eea82ff6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:51.015044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6f16-3aaf-47b1-a6e7-fa51eea82ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:51.035017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cb4b6f16-3aaf-47b1-a6e7-fa51eea82ff6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:51.036255 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cb4b6f16-3aaf-47b1-a6e7-fa51eea82ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:51.041407 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c98ba-8c9d-486f-8f62-94d0fed62bf8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:51.059501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:51.088009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:51.088792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:51.089158 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:51.089488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:51.090322 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=6109aa049e0347bbae8c2e54235e66a0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:51.090700 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:51.092221 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:51.109697 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 433/880] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:50 2022] GET /identity/v3/role_assignments?user.id=6109aa049e0347bbae8c2e54235e66a0&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:51.109697 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:51.130146 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 448/881] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:51.291041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24707f-8360-4130-b832-428c4054b520 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:51.356007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ab29-ace5-49c3-a7ea-fe6a000d69aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:51.357321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ab29-ace5-49c3-a7ea-fe6a000d69aa None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:51.358044 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ab29-ace5-49c3-a7ea-fe6a000d69aa None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:51.358731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ab29-ace5-49c3-a7ea-fe6a000d69aa None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:51.360122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ab29-ace5-49c3-a7ea-fe6a000d69aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:51.363002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ab29-ace5-49c3-a7ea-fe6a000d69aa None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:51.373851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 434/882] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:33:51 2022] GET /identity/v3/services => generated 1011 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:33:51.419895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b6f16-3aaf-47b1-a6e7-fa51eea82ff6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:51.609358 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b6f16-3aaf-47b1-a6e7-fa51eea82ff6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:51.642179 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:51.656044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced93464-8c77-489e-9843-f6d688597148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:51.658345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93464-8c77-489e-9843-f6d688597148 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:51.658832 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93464-8c77-489e-9843-f6d688597148 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:51.659324 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93464-8c77-489e-9843-f6d688597148 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:51.660537 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced93464-8c77-489e-9843-f6d688597148 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:51.663143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced93464-8c77-489e-9843-f6d688597148 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:51.692120 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 449/883] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:33:51 2022] POST /identity/v3/services => generated 269 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:33:53.967239 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d85bc-b507-40a1-bfb6-6096d7c10f6f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:53.968093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d85bc-b507-40a1-bfb6-6096d7c10f6f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:53.968093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d85bc-b507-40a1-bfb6-6096d7c10f6f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:53.969392 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 435/884] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:33:53.975007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd238d4-65ec-432a-ab68-07228280779b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:53.976517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd238d4-65ec-432a-ab68-07228280779b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:53.977004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd238d4-65ec-432a-ab68-07228280779b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.003698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ccd238d4-65ec-432a-ab68-07228280779b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:54.005645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ccd238d4-65ec-432a-ab68-07228280779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:54.150490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 450/885] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:54.248804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ce69a-874b-4b09-9e2c-a1133a6b94a9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:54.249191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ce69a-874b-4b09-9e2c-a1133a6b94a9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:54.249679 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ce69a-874b-4b09-9e2c-a1133a6b94a9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.252447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 436/886] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:54.262581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73bf23-0917-4a19-b211-47cd83713a87 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:54.262773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73bf23-0917-4a19-b211-47cd83713a87 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:54.263167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73bf23-0917-4a19-b211-47cd83713a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.295284 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1f73bf23-0917-4a19-b211-47cd83713a87 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:54.297336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1f73bf23-0917-4a19-b211-47cd83713a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:54.430000 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 451/887] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:54.436489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ce69a-874b-4b09-9e2c-a1133a6b94a9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:54.504749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9293a-09f7-4ad1-b09f-d0528310eeba None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:54.505073 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9293a-09f7-4ad1-b09f-d0528310eeba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:54.505446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9293a-09f7-4ad1-b09f-d0528310eeba None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.507213 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 452/888] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:54.512646 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7a79-638d-4eac-a8fb-cd9756f27edd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:54.513023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7a79-638d-4eac-a8fb-cd9756f27edd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:54.513391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7a79-638d-4eac-a8fb-cd9756f27edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.525126 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:54.542263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-487c7a79-638d-4eac-a8fb-cd9756f27edd None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:54.544193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-487c7a79-638d-4eac-a8fb-cd9756f27edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:54.623363 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:54.642017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ce69a-874b-4b09-9e2c-a1133a6b94a9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:54.668684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 453/889] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:33:54.710953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:54.712332 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:54.713041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:54.713771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.715016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:54.717750 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:54.735492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:54.737747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:54.739802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:54.744644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 437/890] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Sep 22 02:33:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:54.750437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c7a79-638d-4eac-a8fb-cd9756f27edd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:54.903446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c7a79-638d-4eac-a8fb-cd9756f27edd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:54.943185 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:54.965280 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc530e-cd06-4309-b971-25896696f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:54.966289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc530e-cd06-4309-b971-25896696f044 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:54.966753 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc530e-cd06-4309-b971-25896696f044 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:54.967206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc530e-cd06-4309-b971-25896696f044 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.968251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc530e-cd06-4309-b971-25896696f044 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:54.968751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc530e-cd06-4309-b971-25896696f044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:54.971098 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc530e-cd06-4309-b971-25896696f044 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:54.982374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 454/891] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:33:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:54.982374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30afc2-cb8b-42bb-9d27-5fba6ed542cc None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:54.982374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30afc2-cb8b-42bb-9d27-5fba6ed542cc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:54.983185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30afc2-cb8b-42bb-9d27-5fba6ed542cc None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:54.985558 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 455/892] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:54.991665 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30afc2-cb8b-42bb-9d27-5fba6ed542cc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.037181 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:55.099932 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483292-4f13-4ba5-a00e-c5727d5def57 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.106361 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:55.117592 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30afc2-cb8b-42bb-9d27-5fba6ed542cc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.154151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445cdc2-fce5-4499-a283-58a1f9fd2c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.154898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445cdc2-fce5-4499-a283-58a1f9fd2c91 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.155243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445cdc2-fce5-4499-a283-58a1f9fd2c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.155689 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445cdc2-fce5-4499-a283-58a1f9fd2c91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.156410 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445cdc2-fce5-4499-a283-58a1f9fd2c91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:55.158037 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445cdc2-fce5-4499-a283-58a1f9fd2c91 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:55.160975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.161782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.162187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.162594 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.163470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:55.163903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:55.165619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8445cdc2-fce5-4499-a283-58a1f9fd2c91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:55.168917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:55.171186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:55.173420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 438/893] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:33:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:55.175122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 456/894] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:33:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:55.175122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.179619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573e2f5-aca2-4062-994e-95b3ed870ac3 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.180294 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573e2f5-aca2-4062-994e-95b3ed870ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.180733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573e2f5-aca2-4062-994e-95b3ed870ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.204796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2573e2f5-aca2-4062-994e-95b3ed870ac3 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:55.206306 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2573e2f5-aca2-4062-994e-95b3ed870ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:55.300743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 439/895] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:55.301773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573e2f5-aca2-4062-994e-95b3ed870ac3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.322731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6255-0dd5-4adf-904b-78278853d1bd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.325961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:55.381915 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.382749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.383155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.383559 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.396877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:33:55.403625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:55.405531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 457/896] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:55.408456 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.490608 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:55.499082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573e2f5-aca2-4062-994e-95b3ed870ac3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.534842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a210b-917e-4681-b4e5-d7c71c447849 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.566015 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.567006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.567483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.567941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.572076 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:55.572076 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:55.572673 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:55.577356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.578008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.578293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.578567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.579280 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] RBAC: Adding query filter params (interface=public, service_id=fc9de89cbc0c4fc2a808f71c0197e05b, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:55.579588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:55.580953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:55.581466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 440/897] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:55.582788 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.589721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 458/898] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/endpoints?service_id=fc9de89cbc0c4fc2a808f71c0197e05b&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:55.589721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.628489 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:55.717340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d285f7-16cc-4eb9-8adf-77c4773036d4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.725024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3925b-85d1-4afe-93c4-a63478d2824e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.760254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.761265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.761668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.762131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.763005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:55.765365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:55.774845 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.775778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.776235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.776678 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.777827 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:55.778330 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:55.780642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:55.781242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:55.783796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:55.787305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 459/899] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:55.791849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.795750 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 441/900] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:55.797144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:55.829383 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:55.905601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:55.917569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423fe52-a369-441e-8240-dfef7460210c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.955857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0c400-2219-4368-a617-9ee512ca01cc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:55.958099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:55.958886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:55.959248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:55.959526 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:55.960345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:55.960778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:55.962684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:55.968447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 460/901] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:55.969231 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:56.002932 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:56.003571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:56.003851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:56.004123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:56.004776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:56.006252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:56.014028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 442/902] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/services => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:33:56.014745 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:56.142123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57bfd-d3b2-4b69-973a-d9b9a9b41fd8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:56.158896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:56.180757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeceb6-70ce-42e0-b766-621f9282b26c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:56.212413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:56.213447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:56.213989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:56.214673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:56.215587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:56.216127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:56.218982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:56.227010 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 461/903] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:56.231780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:56.232745 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:56.233183 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:56.233476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:56.238785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:56.249393 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:56.250964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:56.269469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:56.271467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:56.273716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:56.273716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:56.273716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:56.273716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 443/904] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:56.277319 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:56.285800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:56.419977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814627e8-e313-41db-ba84-bf2e89ec7693 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:56.482763 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:56.483912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:56.484397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:56.485362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:56.486917 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:56.487451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:56.489922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:56.490227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b27e-486a-4006-8d4a-699117238372 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:56.501599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 462/905] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 22 02:33:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:56.508574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:56.556945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:56.558031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:56.558524 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:56.559006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:56.560168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:56.560761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:56.564197 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:56.585397 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:56.598467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 444/906] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:56.603762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:56.686567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:56.720402 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c2489-1bfb-4540-a08b-f09c26ed74bf None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:56.781632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:56.783210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:56.783896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:56.784585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:56.786172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:56.789298 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:56.821467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447496-1bbf-49d1-90ca-369b812aa047 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:56.833011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 463/907] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:33:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:33:56.910422 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:56.911618 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:56.912107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:56.912415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:56.928665 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:56.931587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:33:56.956605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:56.960343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:56.967204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 445/908] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:33:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:56.968934 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:57.140218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218ad15-b94a-448f-b4e2-215e7c8a808d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:57.186059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:57.187091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:57.187091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:57.187355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:57.188046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:57.188358 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:57.189966 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:57.205469 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:57.229487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 464/909] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 22 02:33:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:57.231988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:57.305856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:57.359563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5876f2-e641-4b19-ab84-c6bebfdb3238 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:57.398769 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:57.399625 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:57.400063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:57.400472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:57.482797 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:57.484615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:57.550532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:57.595693 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 446/910] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:33:57 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:33:57.602824 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:57.777339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca524237-e1b5-45b2-8767-0053140bbfaf None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:57.845236 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:57.846413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:57.846912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:57.847412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:57.867888 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:57.870746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:33:57.901063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:57.902104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:33:57.902984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:33:57.902984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:33:57.902984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:57.904532 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 465/911] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:57.909565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:58.029771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987140c-3be1-4bb6-859f-56114ed58778 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:58.067590 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:58.068201 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.068470 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.068739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.069428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:58.069755 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:58.071122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:58.084211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 447/912] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:58.090033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:58.159225 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:58.256269 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf01d4-09df-48a5-a909-2113b1042b74 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:58.322500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc7023-9a7c-4776-819f-bef557f9185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:58.323496 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc7023-9a7c-4776-819f-bef557f9185f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.323985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc7023-9a7c-4776-819f-bef557f9185f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.324348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc7023-9a7c-4776-819f-bef557f9185f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.338381 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc7023-9a7c-4776-819f-bef557f9185f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:58.341180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc7023-9a7c-4776-819f-bef557f9185f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7bbc7023-9a7c-4776-819f-bef557f9185f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:33:58.362139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:58.363107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:33:58.364025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:33:58.364444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 466/913] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:33:58.371614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:58.396439 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:58.508377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ed368-210a-4d60-8a30-774a7aeac4a8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:58.547706 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:58.548334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.548613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.548883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.549592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:58.549944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:58.551537 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:58.554874 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e91709-7c01-4637-b931-ac73a7c13217 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.555299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e91709-7c01-4637-b931-ac73a7c13217 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.555719 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e91709-7c01-4637-b931-ac73a7c13217 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.558100 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 467/914] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:58.565836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 448/915] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:58.566130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c128d-bad3-4d58-9397-6fad89244bac None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.566608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c128d-bad3-4d58-9397-6fad89244bac None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.567122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c128d-bad3-4d58-9397-6fad89244bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.578009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:58.595899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d28c128d-bad3-4d58-9397-6fad89244bac None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:58.598076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d28c128d-bad3-4d58-9397-6fad89244bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:58.669005 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:58.701954 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d703-ca84-4c77-96dd-72232b8823b4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:58.743832 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 468/916] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:33:58.760073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee29c66-60d9-4347-a396-2c2ac05c633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:58.760687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee29c66-60d9-4347-a396-2c2ac05c633e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.760964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee29c66-60d9-4347-a396-2c2ac05c633e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.761235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee29c66-60d9-4347-a396-2c2ac05c633e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.762002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee29c66-60d9-4347-a396-2c2ac05c633e None admin] RBAC: Adding query filter params (role.id=b16955a423c44c50bc478654a9c86233, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=6109aa049e0347bbae8c2e54235e66a0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:58.762309 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee29c66-60d9-4347-a396-2c2ac05c633e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:58.763735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee29c66-60d9-4347-a396-2c2ac05c633e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:58.770480 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 449/917] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:33:58 2022] GET /identity/v3/role_assignments?user.id=6109aa049e0347bbae8c2e54235e66a0&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b16955a423c44c50bc478654a9c86233 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:33:58.843628 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429027e9-52f3-405c-8a7c-491cd35e3530 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.843815 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429027e9-52f3-405c-8a7c-491cd35e3530 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.844087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429027e9-52f3-405c-8a7c-491cd35e3530 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.845903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 469/918] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:58.852713 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae589d2-5139-4250-9408-5e9ec3dcb8c7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:58.853032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae589d2-5139-4250-9408-5e9ec3dcb8c7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:58.853261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae589d2-5139-4250-9408-5e9ec3dcb8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:58.874531 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1ae589d2-5139-4250-9408-5e9ec3dcb8c7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:58.875780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1ae589d2-5139-4250-9408-5e9ec3dcb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:58.963548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 450/919] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:33:59.260270 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429027e9-52f3-405c-8a7c-491cd35e3530 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:59.300004 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae589d2-5139-4250-9408-5e9ec3dcb8c7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:59.332207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:59.396631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:59.416222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429027e9-52f3-405c-8a7c-491cd35e3530 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:59.442618 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae589d2-5139-4250-9408-5e9ec3dcb8c7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:59.461443 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f5e0-26dc-4309-aa21-717f5dbe78bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:59.462090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f5e0-26dc-4309-aa21-717f5dbe78bf None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:59.462365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f5e0-26dc-4309-aa21-717f5dbe78bf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:59.462744 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f5e0-26dc-4309-aa21-717f5dbe78bf None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:59.463363 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917f5e0-26dc-4309-aa21-717f5dbe78bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:59.464865 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917f5e0-26dc-4309-aa21-717f5dbe78bf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:59.485090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 470/920] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:33:59 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:33:59.487410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c37b-7a36-4c5a-abf0-b7468ceae1be None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:59.487904 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c37b-7a36-4c5a-abf0-b7468ceae1be None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:59.488366 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c37b-7a36-4c5a-abf0-b7468ceae1be None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:59.497202 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 471/921] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:33:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:33:59.499749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a98d-12d8-4e9e-bcce-c5b139ea47e5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:59.500272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a98d-12d8-4e9e-bcce-c5b139ea47e5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:59.500773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a98d-12d8-4e9e-bcce-c5b139ea47e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:59.505815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:59.507676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:59.508330 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:59.508815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:59.509767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:59.512063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:33:59.528997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:33:59.530115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 02:33:59.531013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:33:59.532481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6ec1a98d-12d8-4e9e-bcce-c5b139ea47e5 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:33:59.534116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6ec1a98d-12d8-4e9e-bcce-c5b139ea47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:33:59.538877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 451/922] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Sep 22 02:33:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:33:59.541063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:59.641273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 472/923] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:33:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:33:59.683503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996c40-8a44-438e-8bcd-672094a1dc50 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:59.718823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:59.726757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:59.727700 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:59.728187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:59.728646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:59.729490 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:59.729999 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:59.731590 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:59.738109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 452/924] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:33:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:59.749781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a98d-12d8-4e9e-bcce-c5b139ea47e5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:33:59.781462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:33:59.871569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a98d-12d8-4e9e-bcce-c5b139ea47e5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:33:59.912954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:33:59.913582 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:33:59.913880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:33:59.914156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:33:59.914863 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:33:59.915162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:33:59.916823 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:33:59.922881 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 473/925] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:33:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:33:59.932210 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:00.058079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:00.058627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6bfc7-4495-4e6b-a058-7f2c012f7013 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:00.098386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:00.099204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:00.099579 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:00.099944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:00.101166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:00.102612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:00.138386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 453/926] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:33:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:00.196802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:00.214083 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1e604-62e3-4755-93ab-d290d971f24e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:00.285731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:00.287170 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:00.288207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:00.288671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:00.289560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:00.291554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:00.294623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: WARNING keystone.server.flask.common [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 02:34:00.317036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.sql.core [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 02:34:00.317036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 02:34:00.317036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [parameters: {'id': 'f2a5aa08b31043e58a01beafb71a2d1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 02:34:00.317036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2a5aa08b31043e58a01beafb71a2d1d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2a5aa08b31043e58a01beafb71a2d1d. Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 02:34:00.325900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 22 02:34:00.326795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application yield resource Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise self.value Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application session.commit() Sep 22 02:34:00.327771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.flush() Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application compat.raise_( Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 02:34:00.328684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 02:34:00.329604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 02:34:00.330457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [parameters: {'id': 'f2a5aa08b31043e58a01beafb71a2d1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:00.331326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:00.332093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2a5aa08b31043e58a01beafb71a2d1d. Sep 22 02:34:00.333020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:00.335715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 474/927] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Sep 22 02:34:00 2022] POST /identity/v3/projects => generated 262 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:00.347062 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:00.433980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:00.505500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ba16-2b99-4668-a73b-4c0e00a216c2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:00.564617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370f8a7-a5c8-4d01-8647-1d89373d7390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:00.565675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f8a7-a5c8-4d01-8647-1d89373d7390 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:00.566229 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f8a7-a5c8-4d01-8647-1d89373d7390 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:00.566771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f8a7-a5c8-4d01-8647-1d89373d7390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:00.584423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370f8a7-a5c8-4d01-8647-1d89373d7390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:00.586531 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370f8a7-a5c8-4d01-8647-1d89373d7390 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0370f8a7-a5c8-4d01-8647-1d89373d7390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:34:00.608662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:00.609616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:00.610521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:00.611405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 454/928] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:00.617265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:00.742322 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61722f-f352-47f2-b98e-87434128f91c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:00.782587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b968e97-c169-4b98-a7a8-30dc186ec896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:00.783604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968e97-c169-4b98-a7a8-30dc186ec896 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:00.784089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968e97-c169-4b98-a7a8-30dc186ec896 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:00.784662 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968e97-c169-4b98-a7a8-30dc186ec896 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:00.785615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b968e97-c169-4b98-a7a8-30dc186ec896 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:00.786164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b968e97-c169-4b98-a7a8-30dc186ec896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:00.788105 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b968e97-c169-4b98-a7a8-30dc186ec896 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:00.810476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 475/929] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:34:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:01.953303 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479f892-1b0e-41f3-b1a5-34d980c2a92f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:01.953991 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479f892-1b0e-41f3-b1a5-34d980c2a92f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:01.954372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479f892-1b0e-41f3-b1a5-34d980c2a92f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:01.957201 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 455/930] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:01.966520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43b5c-6b18-44cf-bc9f-3aa9ffca12b7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:01.967052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43b5c-6b18-44cf-bc9f-3aa9ffca12b7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:01.967507 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43b5c-6b18-44cf-bc9f-3aa9ffca12b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:01.980201 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:01.994269 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d2d43b5c-6b18-44cf-bc9f-3aa9ffca12b7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:01.996150 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d2d43b5c-6b18-44cf-bc9f-3aa9ffca12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:02.071282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 476/931] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:34:02.243383 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbeb5-de2f-4e28-a588-26d57229e02c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:02.243686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbeb5-de2f-4e28-a588-26d57229e02c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:02.243863 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbeb5-de2f-4e28-a588-26d57229e02c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:02.245617 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 456/932] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:02.251653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a84d-2437-470b-b688-00a1fb3ab8fe None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:02.251978 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a84d-2437-470b-b688-00a1fb3ab8fe None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:02.252292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a84d-2437-470b-b688-00a1fb3ab8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:02.273077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-07f5a84d-2437-470b-b688-00a1fb3ab8fe None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:02.274391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-07f5a84d-2437-470b-b688-00a1fb3ab8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:02.355701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 477/933] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:02.595193 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfbeb5-de2f-4e28-a588-26d57229e02c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:02.634995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5a84d-2437-470b-b688-00a1fb3ab8fe None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:02.718199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:02.757483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfbeb5-de2f-4e28-a588-26d57229e02c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:02.768699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5a84d-2437-470b-b688-00a1fb3ab8fe None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:02.770016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:02.810007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28edeb3-6ed3-4182-ba5e-38209fe0cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:02.810852 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28edeb3-6ed3-4182-ba5e-38209fe0cba9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:02.811194 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e926657-601e-4544-9cb4-bde790a292a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:02.811424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28edeb3-6ed3-4182-ba5e-38209fe0cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:02.811773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28edeb3-6ed3-4182-ba5e-38209fe0cba9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:02.811945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e926657-601e-4544-9cb4-bde790a292a2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:02.812084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e926657-601e-4544-9cb4-bde790a292a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:02.812371 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e926657-601e-4544-9cb4-bde790a292a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:02.812980 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e926657-601e-4544-9cb4-bde790a292a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:02.814439 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e926657-601e-4544-9cb4-bde790a292a2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8e926657-601e-4544-9cb4-bde790a292a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:02.824587 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:02.826688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:02.827583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:02.830136 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28edeb3-6ed3-4182-ba5e-38209fe0cba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:02.831152 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 478/934] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:34:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:02.832314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ee18c-13e9-46c8-bb94-bc93a561d789 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:02.832578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ee18c-13e9-46c8-bb94-bc93a561d789 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:02.832865 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ee18c-13e9-46c8-bb94-bc93a561d789 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:02.835003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 479/935] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a28edeb3-6ed3-4182-ba5e-38209fe0cba9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:02.837373 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:02.842242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:02.843083 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:02.843716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ee18c-13e9-46c8-bb94-bc93a561d789 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:02.843791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 457/936] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 22 02:34:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:02.843791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f47ef0-3bb2-4e5a-9b33-e8372b90c3cc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:02.843791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f47ef0-3bb2-4e5a-9b33-e8372b90c3cc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:02.843791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f47ef0-3bb2-4e5a-9b33-e8372b90c3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:02.869753 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-06f47ef0-3bb2-4e5a-9b33-e8372b90c3cc None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:02.871554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-06f47ef0-3bb2-4e5a-9b33-e8372b90c3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:02.968225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 458/937] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:02.971169 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f47ef0-3bb2-4e5a-9b33-e8372b90c3cc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:02.997560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ee18c-13e9-46c8-bb94-bc93a561d789 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:03.042945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:03.061048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:03.062668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.063442 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.064205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.065617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:03.066468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:03.069489 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:03.085723 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 480/938] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:03.091177 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:03.192879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:03.201389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f47ef0-3bb2-4e5a-9b33-e8372b90c3cc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:03.282082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7389-7dd6-49a5-968d-8286c2d17560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:03.283054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7389-7dd6-49a5-968d-8286c2d17560 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.283543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7389-7dd6-49a5-968d-8286c2d17560 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.284020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7389-7dd6-49a5-968d-8286c2d17560 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.285225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7389-7dd6-49a5-968d-8286c2d17560 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:03.285764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7389-7dd6-49a5-968d-8286c2d17560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:03.288814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7389-7dd6-49a5-968d-8286c2d17560 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:03.299498 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cab74-eaae-49c7-bcaf-32446cbb45a4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:03.304214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 459/939] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 22 02:34:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:03.313100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6198-b52c-4e60-93fd-879cc8f3b2ed None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.313933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6198-b52c-4e60-93fd-879cc8f3b2ed None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.314425 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6198-b52c-4e60-93fd-879cc8f3b2ed None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.317076 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 460/940] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:03.318276 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6198-b52c-4e60-93fd-879cc8f3b2ed None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:03.348515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab66aa-4bbb-4fa6-848f-cd01c774f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:03.349126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab66aa-4bbb-4fa6-848f-cd01c774f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.349396 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab66aa-4bbb-4fa6-848f-cd01c774f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.349684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab66aa-4bbb-4fa6-848f-cd01c774f3a5 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.350854 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab66aa-4bbb-4fa6-848f-cd01c774f3a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:03.351678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab66aa-4bbb-4fa6-848f-cd01c774f3a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:03.352511 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab66aa-4bbb-4fa6-848f-cd01c774f3a5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:03.365682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 481/941] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:03.365682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835c70-9db9-41c8-b503-a7c2382edb86 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.365682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835c70-9db9-41c8-b503-a7c2382edb86 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.365682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835c70-9db9-41c8-b503-a7c2382edb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.387508 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-15835c70-9db9-41c8-b503-a7c2382edb86 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:03.389400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-15835c70-9db9-41c8-b503-a7c2382edb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:03.469277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:03.489439 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6198-b52c-4e60-93fd-879cc8f3b2ed None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:03.490297 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 482/942] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:03.491669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835c70-9db9-41c8-b503-a7c2382edb86 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:03.533134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:03.533977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.534550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.535061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.553792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:03.556372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:03.587517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:03.589491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:03.591969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:03.591969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:03.591969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:03.593874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 461/943] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:03.595681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:03.630217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:03.653130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835c70-9db9-41c8-b503-a7c2382edb86 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:03.715227 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:03.715955 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.716389 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.716794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.718004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] RBAC: Adding query filter params (interface=public, service_id=eeee0b944b304928a28f0e61f277f659, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:03.718469 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:03.720077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:03.734569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 483/944] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:34:03 2022] GET /identity/v3/endpoints?service_id=eeee0b944b304928a28f0e61f277f659&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:03.734569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:03.785588 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5fcd-d3e3-46aa-b592-d46503454858 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:03.806754 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:03.845040 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:03.846054 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.846504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.846939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.847891 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:03.850296 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:03.864896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:03.866889 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:03.868512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 462/945] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:03.870065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:03.902799 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f177839-41f3-4450-a90f-7f014d073f2f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:03.950869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:03.951619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:03.951972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:03.952294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:03.953155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:03.953519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:03.954975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:03.968715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 484/946] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:03.969607 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:03.989540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:04.014023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc047f-26a6-48f8-bb19-72ec5483e7c3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.069597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.070653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.071127 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.071609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.072684 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.075267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:04.079947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c31cc5-861f-4482-bf31-4ed7fe7ab1b7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.087098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 463/947] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:34:03 2022] GET /identity/v3/services => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:34:04.088286 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:04.102818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:04.154183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.154925 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.155286 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.155635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.156383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:04.156796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.158349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:04.169960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 485/948] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:34:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:04.169960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:04.290687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fac99-2d29-4722-82ad-37b9cd892d3c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.327668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e8ff5-4c42-452d-8889-a1726be22c76 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.349065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.350156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.351206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.351735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.352730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.355316 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:04.359487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WARNING keystone.server.flask.common [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 02:34:04.377091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.sql.core [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 02:34:04.377091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 02:34:04.377091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [parameters: {'user_id': '6b89fb7fc01c4deaac3e58f7a98d757f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 02:34:04.377091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 02:34:04.383029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.384550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.385516 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.385992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.397815 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application conn.query(q) Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result.read() Sep 22 02:34:04.399187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 02:34:04.401261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application next(self.gen) Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application yield resource Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application next(self.gen) Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise self.value Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application session.commit() Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 02:34:04.404010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.session.flush() Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application compat.raise_( Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 02:34:04.406609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 02:34:04.410814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application conn.query(q) Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result.read() Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 02:34:04.412892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [parameters: {'user_id': '6b89fb7fc01c4deaac3e58f7a98d757f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:04.415238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 22 02:34:04.417613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 22 02:34:04.419771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 22 02:34:04.419771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 22 02:34:04.419771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 02:34:04.419771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 02:34:04.419771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 02:34:04.419771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:04.419771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 464/949] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 22 02:34:04 2022] POST /identity/v3/users => generated 160 bytes in 313 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:04.420723 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:04.420875 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:04.420875 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:34:04.431908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:04.433393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 486/950] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:34:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:04.435674 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:04.476050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:04.562876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b080f1-6871-4419-9fbb-26bbc117d406 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.602840 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.603485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.603761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.604032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.604705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:04.604930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead52cf4-e251-4155-aa45-c6b279adb8dc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.605089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.606724 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:04.615328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 465/951] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:34:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:04.615328 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:04.677912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.679108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.680028 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.680521 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.698859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.701786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:34:04.729534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:04.730697 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 02:34:04.731641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:04.732699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 487/952] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:34:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:04.738292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:04.750186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:04.808039 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3fd3-9769-42f5-bd5e-8728032e3f62 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.858427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.858970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.859244 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.859510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.860255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:04.860557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.862040 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:04.902207 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 466/953] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 22 02:34:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:04.908526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:04.914731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:04.927962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d65c6-359a-4d64-8972-e46527100ed9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:04.979475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:04.980491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:04.980986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:04.981482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:04.982831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:04.983336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:04.986120 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:05.031753 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0a838-59dd-4981-a07d-d774baf7bbd7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:05.067226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:05.074640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 488/954] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 22 02:34:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:05.085270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:05.085982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:05.086334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:05.086619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:05.100002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:05.102119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:05.120428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:05.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:05.124230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:05.124230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:05.124230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:05.124230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 467/955] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:05.134909 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:05.268007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cc979-ba92-4d1a-876f-631017855f34 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:05.318172 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:05.319450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:05.319815 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:05.320164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:05.320934 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:05.321318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:05.322859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:05.338686 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 489/956] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:05.344492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:05.474329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f6fd-76a2-4450-80dd-335cb937a634 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:05.520600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:05.521626 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:05.522167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:05.522683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:05.532711 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:05.534598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:34:05.554907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:05.555974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:05.556988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 468/957] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:05.564078 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:05.585571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:05.733009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842fb52-448c-4ec7-8aa5-db262ecfe8b4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:05.792187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3601-d5d3-42b6-9f9b-3c9d865f5d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:05.793238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3601-d5d3-42b6-9f9b-3c9d865f5d39 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:05.795290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3601-d5d3-42b6-9f9b-3c9d865f5d39 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:05.795682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3601-d5d3-42b6-9f9b-3c9d865f5d39 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:05.796987 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3601-d5d3-42b6-9f9b-3c9d865f5d39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:05.797926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3601-d5d3-42b6-9f9b-3c9d865f5d39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:05.800748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3601-d5d3-42b6-9f9b-3c9d865f5d39 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:05.826416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 490/958] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:05.836675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:05.918240 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:06.032532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa302b-ab3a-4a68-9f45-82c32d3417a3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:06.074263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268c31c-470f-48ec-acc1-bfde085703a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:06.075105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c31c-470f-48ec-acc1-bfde085703a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:06.075527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c31c-470f-48ec-acc1-bfde085703a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:06.075977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c31c-470f-48ec-acc1-bfde085703a8 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/6109aa049e0347bbae8c2e54235e66a0/roles/b16955a423c44c50bc478654a9c86233` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:06.078483 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268c31c-470f-48ec-acc1-bfde085703a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=6109aa049e0347bbae8c2e54235e66a0, role_id=b16955a423c44c50bc478654a9c86233)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:06.080116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268c31c-470f-48ec-acc1-bfde085703a8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:06.105686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 469/959] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:34:05 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/6109aa049e0347bbae8c2e54235e66a0/roles/b16955a423c44c50bc478654a9c86233 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:34:06.856336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf016-a17f-4da6-b873-e77990b4dfc8 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:06.856962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf016-a17f-4da6-b873-e77990b4dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:06.856962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf016-a17f-4da6-b873-e77990b4dfc8 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:06.858548 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 491/960] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:06.864217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccc72-0f5c-4dd6-9a1f-036d488f3113 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:06.864598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccc72-0f5c-4dd6-9a1f-036d488f3113 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:06.864849 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccc72-0f5c-4dd6-9a1f-036d488f3113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:06.885550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a5dccc72-0f5c-4dd6-9a1f-036d488f3113 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:06.887023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a5dccc72-0f5c-4dd6-9a1f-036d488f3113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:06.973732 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 470/961] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:07.143669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59d21-60c4-4deb-9115-9437b5f99091 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:07.144074 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59d21-60c4-4deb-9115-9437b5f99091 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:07.144553 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59d21-60c4-4deb-9115-9437b5f99091 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:07.147599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 492/962] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:07.153502 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc601d-5852-43bd-a42b-f99589fc87d4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:07.154427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc601d-5852-43bd-a42b-f99589fc87d4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:07.154427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc601d-5852-43bd-a42b-f99589fc87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:07.173925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-91bc601d-5852-43bd-a42b-f99589fc87d4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:07.175141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-91bc601d-5852-43bd-a42b-f99589fc87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:07.205582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:07.244184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59d21-60c4-4deb-9115-9437b5f99091 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:07.274024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 471/963] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:07.377858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:07.439667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59d21-60c4-4deb-9115-9437b5f99091 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:07.503277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:07.504311 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:07.504793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:07.505252 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:07.506875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:07.509342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:07.526554 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:07.530254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:07.531924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 493/964] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:34:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:07.539748 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc601d-5852-43bd-a42b-f99589fc87d4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:07.724741 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc601d-5852-43bd-a42b-f99589fc87d4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:07.730651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:07.781257 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:07.782146 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:07.782596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:07.783048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:07.784064 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:07.784557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:07.786961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:07.793563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 472/965] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:07.800185 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:07.831378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:07.883526 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9d168-d8d3-46ff-9a3a-4be08517e6da None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:07.938993 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:07.939982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:07.940341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:07.940810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:07.942011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:07.944879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:07.951976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:07.964321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55078-43cc-4929-a652-e4c4f5e060c6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:07.974461 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 494/966] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:34:07 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:34:08.022869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5486-bc77-4688-8918-28d8cd4e4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:08.023591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5486-bc77-4688-8918-28d8cd4e4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:08.023998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5486-bc77-4688-8918-28d8cd4e4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:08.024427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5486-bc77-4688-8918-28d8cd4e4cf1 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:08.025235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5486-bc77-4688-8918-28d8cd4e4cf1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:08.025702 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5486-bc77-4688-8918-28d8cd4e4cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:08.027308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5486-bc77-4688-8918-28d8cd4e4cf1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:08.038917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 473/967] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:08.041003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:08.167889 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d148e-3af3-4609-a21b-31591809fbab None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:08.211778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3d405-daf5-4dff-9314-d7be9148e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:08.212419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d405-daf5-4dff-9314-d7be9148e72f None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:08.212696 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d405-daf5-4dff-9314-d7be9148e72f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:08.212968 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d405-daf5-4dff-9314-d7be9148e72f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:08.213732 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3d405-daf5-4dff-9314-d7be9148e72f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:08.215134 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3d405-daf5-4dff-9314-d7be9148e72f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:08.241300 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 495/968] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:34:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:08.546357 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23181-3aa4-4a23-b0c2-e24c5b2b3828 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:08.547174 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23181-3aa4-4a23-b0c2-e24c5b2b3828 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:08.547174 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23181-3aa4-4a23-b0c2-e24c5b2b3828 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:08.549850 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 474/969] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:08.558578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32b57-b72b-4f33-ac80-4cfae2ef6977 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:08.559027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32b57-b72b-4f33-ac80-4cfae2ef6977 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:08.559515 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32b57-b72b-4f33-ac80-4cfae2ef6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:08.593890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-33a32b57-b72b-4f33-ac80-4cfae2ef6977 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:08.595945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-33a32b57-b72b-4f33-ac80-4cfae2ef6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:08.697785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:08.750216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 496/970] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:09.252815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23181-3aa4-4a23-b0c2-e24c5b2b3828 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:09.405485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:09.432744 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23181-3aa4-4a23-b0c2-e24c5b2b3828 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:09.474688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:09.475393 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:09.475668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:09.475941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:09.488658 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:09.494329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:09.496020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:09.497574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:09.500886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 475/971] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 22 02:34:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:09.502527 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a32b57-b72b-4f33-ac80-4cfae2ef6977 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:09.634422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a32b57-b72b-4f33-ac80-4cfae2ef6977 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:09.679691 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:09.680731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:09.681184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:09.681693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:09.682704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:09.683127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:09.685364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:09.704936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 497/972] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 22 02:34:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:09.706440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:09.821000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416dcf-bf4c-4180-8e0d-592457e0f584 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:09.861202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:09.861857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:09.862131 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:09.862396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:09.874166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:09.875515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:09.877598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:09.894115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:09.895961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:09.903394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:09.903394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:09.903394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:09.903394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 476/973] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:09.904616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:09.952911 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:10.021377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b71bf-56d4-46e2-9bb1-28893abdbd89 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:10.075211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:10.076192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.076682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.077167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.078343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:10.078879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:10.081405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:10.108453 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 498/974] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:10.110478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:10.258993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabd32b-91ed-4ce9-a707-ea5f5d5c219e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:10.297552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:10.298210 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.298476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.298735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.307654 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:10.309107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:34:10.321803 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:10.328556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:10.329538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 477/975] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:34:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:10.330608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:10.480882 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:10.485723 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677452-66ee-4904-ad03-cd9275b048e4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:10.531075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17d13-49dc-4e39-96e6-9047ae37d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:10.532031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17d13-49dc-4e39-96e6-9047ae37d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.532031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17d13-49dc-4e39-96e6-9047ae37d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.532271 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17d13-49dc-4e39-96e6-9047ae37d5d3 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.532901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17d13-49dc-4e39-96e6-9047ae37d5d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:10.533208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17d13-49dc-4e39-96e6-9047ae37d5d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:10.534731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17d13-49dc-4e39-96e6-9047ae37d5d3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:10.557698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 499/976] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 22 02:34:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:10.564344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:10.577783 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca15b7-f112-4eb8-a46e-79955249249c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.578237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca15b7-f112-4eb8-a46e-79955249249c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.578686 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca15b7-f112-4eb8-a46e-79955249249c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.581307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 500/977] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:10.590865 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877032a-f05b-4615-88e3-6ea3a8fbb445 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.591297 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877032a-f05b-4615-88e3-6ea3a8fbb445 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.591752 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877032a-f05b-4615-88e3-6ea3a8fbb445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.618386 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1877032a-f05b-4615-88e3-6ea3a8fbb445 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:10.620168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1877032a-f05b-4615-88e3-6ea3a8fbb445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:10.665320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:10.715555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 501/978] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:10.734394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40b843-eb7f-40b2-871d-2cbfdb7dc630 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:10.779097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:10.779906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.780312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.780719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.795882 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaa2a5-97bc-4b56-a6f0-db178045747d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.796117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaa2a5-97bc-4b56-a6f0-db178045747d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.796317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaa2a5-97bc-4b56-a6f0-db178045747d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.797950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 502/979] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:10.803484 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8172-a805-4894-ae4f-4ba842ee9149 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:10.803807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8172-a805-4894-ae4f-4ba842ee9149 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:10.804038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8172-a805-4894-ae4f-4ba842ee9149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:10.823517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d4db8172-a805-4894-ae4f-4ba842ee9149 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:10.824746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d4db8172-a805-4894-ae4f-4ba842ee9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:10.863724 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:10.865190 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:10.903750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 503/980] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:34:10.930978 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:10.991086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 478/981] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:10 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:34:10.991386 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8172-a805-4894-ae4f-4ba842ee9149 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:10.999436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.011774 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:11.103041 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8172-a805-4894-ae4f-4ba842ee9149 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.140066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.140741 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.141024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.141736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.142044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.143422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:11.153327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:11.154725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:11.155575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 504/982] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:34:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:11.163096 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.163738 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a524a0-270f-42b7-bcb7-0c06e1fd1b0b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.209570 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.210583 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.211034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.211478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.227486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.229980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:11.255912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:11.257202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:11.258476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:11.258476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:11.258476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:11.258476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 479/983] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:11.259407 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.269065 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:11.278025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:11.299853 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7657f-6800-48f2-951e-4fdc761cc121 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.335324 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.335941 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.336218 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.336492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.337131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:11.337433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.338856 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.343992 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 505/984] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:11.344834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.371687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ca26-a024-4fd3-b046-a797d98e52a2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.409158 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.410013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.410379 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.410816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.411565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.413569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:11.423446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:11.425398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:11.427130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 480/985] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:11.429310 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.455849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e5d4b-1f2e-456f-972e-7075da8a21c9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.492375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.492993 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.493275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.493550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.494237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:11.494545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.495919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.502358 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:11.509273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 506/986] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:11.510143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.519843 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:11.544121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5468eb-c90f-4883-9bc1-5e0481f3d36f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.589547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.590711 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.591203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.591684 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.592846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:11.593362 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.595853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.603627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 481/987] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:11.604495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.635703 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27406-2f68-455b-b38c-0921236bf842 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.694920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.695988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.696470 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.696953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.698131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:11.698673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.701200 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.715016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 507/988] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:11.715016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.715341 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82676342-f59b-4fee-8a9f-7767e56203a8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.754068 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.754764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.754983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.755255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.759106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:11.769247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.772140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:34:11.793621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:11.795048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:11.796500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 482/989] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:11.797494 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.820338 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:11.861441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677f54-b02e-437d-aed2-82def0585fcd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.918872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881029-ec46-4de8-8e2b-907186884377 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:11.920600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.921640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.922178 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.922519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.923424 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] RBAC: Adding query filter params (interface=admin, service_id=eeee0b944b304928a28f0e61f277f659, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:11.923989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.926643 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.935895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 508/990] 10.222.0.57 () {56 vars in 1249 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/endpoints?service_id=eeee0b944b304928a28f0e61f277f659&interface=admin®ion_id=RegionOne => generated 193 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:11.937375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:11.965134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:11.966114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:11.966578 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:11.967022 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:11.968000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:11.968494 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:11.970887 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:11.979107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 483/991] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:11.980255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:12.065851 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00b95-3fd4-4256-9d11-356dc7702879 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:12.067436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:12.106611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:12.107222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:12.107502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:12.107775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:12.108507 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:12.108812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:12.110279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:12.112061 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:12.123035 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7882c4-135e-4715-a0ec-b7b2cf201a24 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:12.124557 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 509/992] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:12.125158 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:12.182983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:12.184037 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:12.184517 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:12.184979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:12.186136 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:12.188757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:12.200636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 484/993] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:34:11 2022] GET /identity/v3/services => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:34:12.201823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:12.246503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bcdc-862c-498f-9f0c-a17480d1e8bc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:12.295997 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:12.296823 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:12.297300 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:12.297780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:12.298651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] RBAC: Adding query filter params (interface=public, service_id=064cfe7197a24469b0a66c5f015ed1c2, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:12.299102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:12.300860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:12.313106 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 510/994] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:34:12 2022] GET /identity/v3/endpoints?service_id=064cfe7197a24469b0a66c5f015ed1c2&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:12.314950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:12.390980 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:12.413622 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e93fd9-9f18-46e1-9515-23af0d370886 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:12.452593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:12.464694 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0a7c6-d62b-474d-a9cf-d6d769b14d79 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:12.477935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9bad-812e-4926-a243-4967664efe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:12.478981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9bad-812e-4926-a243-4967664efe05 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:12.479437 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9bad-812e-4926-a243-4967664efe05 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:12.479926 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9bad-812e-4926-a243-4967664efe05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:12.481258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d9bad-812e-4926-a243-4967664efe05 None admin] RBAC: Adding query filter params (role.id=b16955a423c44c50bc478654a9c86233, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=6109aa049e0347bbae8c2e54235e66a0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:12.481849 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d9bad-812e-4926-a243-4967664efe05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:12.484574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d9bad-812e-4926-a243-4967664efe05 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:12.505700 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 485/995] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:12 2022] GET /identity/v3/role_assignments?user.id=6109aa049e0347bbae8c2e54235e66a0&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b16955a423c44c50bc478654a9c86233 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:12.542835 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ad86a-fd5c-455c-81fd-7ecccf1f66bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:12.543883 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ad86a-fd5c-455c-81fd-7ecccf1f66bc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:12.544406 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ad86a-fd5c-455c-81fd-7ecccf1f66bc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:12.544889 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ad86a-fd5c-455c-81fd-7ecccf1f66bc None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:12.546101 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ad86a-fd5c-455c-81fd-7ecccf1f66bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:12.548652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ad86a-fd5c-455c-81fd-7ecccf1f66bc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:12.563308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 511/996] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:34:12 2022] GET /identity/v3/services => generated 1727 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 02:34:14.703417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20fbc8-5eb6-4ae6-a0ba-3f82cf5978a6 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:14.703937 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20fbc8-5eb6-4ae6-a0ba-3f82cf5978a6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:14.704394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20fbc8-5eb6-4ae6-a0ba-3f82cf5978a6 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:14.706689 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 486/997] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:14.712666 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a836-6098-4cf4-b8f5-5b38c9a08479 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:14.713448 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a836-6098-4cf4-b8f5-5b38c9a08479 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:14.713585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a836-6098-4cf4-b8f5-5b38c9a08479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:14.734551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b159a836-6098-4cf4-b8f5-5b38c9a08479 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:14.736033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b159a836-6098-4cf4-b8f5-5b38c9a08479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:14.829560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 512/998] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:14.859841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a2ed3-a23d-4fbc-8624-5896524ad571 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:14.860242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a2ed3-a23d-4fbc-8624-5896524ad571 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:14.860415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a2ed3-a23d-4fbc-8624-5896524ad571 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:14.862098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 487/999] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:14.869760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fecc2-bd4a-4343-89d6-9eb8d8748387 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:14.870179 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fecc2-bd4a-4343-89d6-9eb8d8748387 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:14.870330 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fecc2-bd4a-4343-89d6-9eb8d8748387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:14.891772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-640fecc2-bd4a-4343-89d6-9eb8d8748387 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:14.892928 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-640fecc2-bd4a-4343-89d6-9eb8d8748387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:14.960434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:14.994529 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 513/1000] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:15.081291 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85dce4-9804-4040-a35a-4ad598a5d808 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.081632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85dce4-9804-4040-a35a-4ad598a5d808 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.081908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85dce4-9804-4040-a35a-4ad598a5d808 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.083374 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 488/1001] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:15.088830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d849c-64b1-4f02-b184-d4be7c32fe84 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.089122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d849c-64b1-4f02-b184-d4be7c32fe84 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.089403 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d849c-64b1-4f02-b184-d4be7c32fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.108707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0d5d849c-64b1-4f02-b184-d4be7c32fe84 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:15.109944 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0d5d849c-64b1-4f02-b184-d4be7c32fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:15.113813 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85dce4-9804-4040-a35a-4ad598a5d808 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.184884 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 514/1002] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:15.231301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85dce4-9804-4040-a35a-4ad598a5d808 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.267187 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.273730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.274234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.274662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.275420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.277078 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:15.288540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:15.291067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 02:34:15.292472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:15.300769 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 489/1003] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:15.303707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d849c-64b1-4f02-b184-d4be7c32fe84 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.410584 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.441383 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d849c-64b1-4f02-b184-d4be7c32fe84 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.457976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:15.471130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:15.487608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.488539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.488930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.489374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.490203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:15.490669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.492174 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:15.503471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 515/1004] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:15.503471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.533890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1ee0-304d-4b43-8bed-a08171126640 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.574482 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.575236 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.575582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.575918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] PATH_INFO: `/v3/services/compute` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.576583 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.578183 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:15.588283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:15.594242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:15.595184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 490/1005] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:15.595986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.612887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6894-f104-4043-944c-03061cc856f2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.657771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.658551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.658917 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.659281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.660326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.661855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:15.672858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:15.674416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:15.675397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 516/1006] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:15.676275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.719973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:15.730934 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23eaafd-4c66-4435-9994-f41feddc44db None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.747595 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:15.774310 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.774961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.775254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.775532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.776161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:15.776463 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.777864 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:15.781253 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2e30-4b69-4965-9ac7-d0d81fcab2b5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.782859 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 491/1007] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:15.783663 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.819720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.820555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.820899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.821339 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.822171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:15.822613 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.824134 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:15.829991 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 517/1008] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:15.830730 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.903431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fec3b-6d04-49a5-b73d-362fb4659189 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.939526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.940137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.940415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.940724 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.941326 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] RBAC: Adding query filter params (name=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:15.941692 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.943064 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:15.946075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e27f9-1403-422e-ba7c-fd8c6e256af3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:15.949051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 492/1009] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:15.949395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:15.949751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:15.985128 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:15.985646 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:15.985950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:15.986227 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:15.986889 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:15.988250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:16.009705 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 518/1010] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:34:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:16.010118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:16.032487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:16.113559 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d50e27-3382-455b-86ba-7a33fe579c25 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:16.166486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:16.167119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:16.167436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:16.168526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:16.168526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:16.168839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:16.170272 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:16.173522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90263f55-12e6-4626-a8fa-1e8a6820a9a9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:16.183668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 493/1011] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 22 02:34:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:16.184465 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:16.219719 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97478-24c3-4cb5-b15c-68606ddad295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:16.220551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97478-24c3-4cb5-b15c-68606ddad295 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:16.220989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97478-24c3-4cb5-b15c-68606ddad295 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:16.221477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97478-24c3-4cb5-b15c-68606ddad295 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:16.222280 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97478-24c3-4cb5-b15c-68606ddad295 None admin] RBAC: Adding query filter params (type=image) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:16.222787 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97478-24c3-4cb5-b15c-68606ddad295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:16.225116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97478-24c3-4cb5-b15c-68606ddad295 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:16.234277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 519/1012] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:16.348736 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1b5b5-e3c0-4502-9648-e80b708ad44d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:16.351595 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:16.410141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29973e8f-f1bc-41b6-89f0-09a18b35c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:16.411105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29973e8f-f1bc-41b6-89f0-09a18b35c6ad None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:16.411542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29973e8f-f1bc-41b6-89f0-09a18b35c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:16.411978 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29973e8f-f1bc-41b6-89f0-09a18b35c6ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:16.413126 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29973e8f-f1bc-41b6-89f0-09a18b35c6ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:16.415429 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29973e8f-f1bc-41b6-89f0-09a18b35c6ad None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:16.457686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 494/1013] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:34:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:18.421052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756dad-d247-4ad6-8648-7390001eb7bd None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:18.421748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756dad-d247-4ad6-8648-7390001eb7bd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:18.422039 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756dad-d247-4ad6-8648-7390001eb7bd None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:18.424612 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 520/1014] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:18.434850 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2bc4-9f2e-444d-a66f-11d913fc6151 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:18.435607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2bc4-9f2e-444d-a66f-11d913fc6151 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:18.435912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2bc4-9f2e-444d-a66f-11d913fc6151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:18.460625 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d0fd2bc4-9f2e-444d-a66f-11d913fc6151 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:18.461918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d0fd2bc4-9f2e-444d-a66f-11d913fc6151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:18.565389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 495/1015] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:18 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:18.656414 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0df6c-f2b3-4e4e-a502-c00662df0d12 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:18.656677 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0df6c-f2b3-4e4e-a502-c00662df0d12 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:18.656984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0df6c-f2b3-4e4e-a502-c00662df0d12 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:18.658571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 521/1016] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:18.664230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a9542-f532-4fc1-8b72-1850ca84cdb4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:18.664511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a9542-f532-4fc1-8b72-1850ca84cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:18.664791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a9542-f532-4fc1-8b72-1850ca84cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:18.685915 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bb1a9542-f532-4fc1-8b72-1850ca84cdb4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:18.687172 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bb1a9542-f532-4fc1-8b72-1850ca84cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:18.794197 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 496/1017] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:18 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:18.849427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824d451-b007-4ddd-b5de-7f89cdc1b67a None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:18.849977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824d451-b007-4ddd-b5de-7f89cdc1b67a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:18.850130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824d451-b007-4ddd-b5de-7f89cdc1b67a None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:18.851560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 522/1018] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:18.856950 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f054-f4e0-4316-a98f-37a2ea4cf139 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:18.857246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f054-f4e0-4316-a98f-37a2ea4cf139 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:18.857497 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f054-f4e0-4316-a98f-37a2ea4cf139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:18.863489 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824d451-b007-4ddd-b5de-7f89cdc1b67a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:18.876436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ffb3f054-f4e0-4316-a98f-37a2ea4cf139 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:18.877647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ffb3f054-f4e0-4316-a98f-37a2ea4cf139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:18.888735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:18.901076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:18.958424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 497/1019] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:18 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:18.988115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824d451-b007-4ddd-b5de-7f89cdc1b67a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:19.023572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:19.024205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:19.024480 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:19.024749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:19.025901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:19.027315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:19.029056 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 523/1020] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:19.035914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3f054-f4e0-4316-a98f-37a2ea4cf139 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:19.070425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:19.154300 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3f054-f4e0-4316-a98f-37a2ea4cf139 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:19.169328 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:19.179906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c531d-8361-446b-805b-58dfa1613b89 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:19.193874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:19.194761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:19.195038 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:19.195304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:19.195962 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:19.197377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:19.215001 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:19.216209 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:19.217444 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:19.217905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:19.218367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:19.219510 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:19.221367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:19.231524 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 498/1021] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:34:19 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:34:19.235975 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:19.244355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 524/1022] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:34:19 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:34:19.366302 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e541879-4018-4b84-b7b3-261b95b45c35 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:19.414928 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:19.415841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:19.416117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:19.416381 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:19.429269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:19.434896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:19.436411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:19.437402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 499/1023] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 22 02:34:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:19.442730 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:19.555424 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338dc36-d311-4272-83a2-0b601de14af1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:19.596597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:19.597226 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:19.597502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:19.597810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:19.598490 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:19.598792 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:19.600219 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:19.609232 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 525/1024] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 22 02:34:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:19.615251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:19.676994 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:19.727661 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b4af3-5645-4028-82c9-c7801ad7602a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:19.763449 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:19.764087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:19.764364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:19.764636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:19.777786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:19.777982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:19.793839 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:19.796802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:19.797764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:19.797764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:19.797764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:19.797764 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 500/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:19.801050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:19.819942 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:19.971916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2d04-0d1f-4cbe-b250-5fa7d9f2f2ca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:20.029066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:20.030483 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:20.031259 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:20.031957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:20.033345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:20.034113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:20.036807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:20.065688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 526/1026] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:20.068312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:20.241035 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf8478-2b3b-4a0d-ad61-e54f1b5af811 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:20.245233 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:20.297297 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:20.298708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:20.299382 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:20.300082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:20.313446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:20.316418 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:34:20.336128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:20.337989 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:20.340263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 501/1027] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:34:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:20.344678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:20.468366 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:20.513704 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f377e66-ea65-4fdc-a6de-6dd383916a3c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:20.579659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:20.580402 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:20.580853 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:20.581127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:20.582091 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:20.582400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:20.584827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:20.608135 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 527/1028] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:34:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:20.613843 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:20.747230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f72954-cb6c-43dc-a566-f41bc1f0b845 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:20.792413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:20.792953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:20.793236 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:20.793509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:20.836536 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:20.896800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:20.899488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:21.048816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 502/1029] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 02:34:21.059019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:21.234476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b47ad5-af3b-4a8d-a46e-fa94ccec7660 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:21.286935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:21.296150 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c5ff0-6753-42e5-8819-eb2e20f4980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:21.297228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5ff0-6753-42e5-8819-eb2e20f4980d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.297720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5ff0-6753-42e5-8819-eb2e20f4980d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.298183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5ff0-6753-42e5-8819-eb2e20f4980d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.316563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c5ff0-6753-42e5-8819-eb2e20f4980d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:21.319769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c5ff0-6753-42e5-8819-eb2e20f4980d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9f4c5ff0-6753-42e5-8819-eb2e20f4980d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:21.348961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:21.350346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:21.358801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:21.358801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:21.358801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:21.358801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 528/1030] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:21.359275 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:21.429411 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:21.483995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc37b0-55c4-4d15-ade9-dc59d7a700a1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:21.538647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:21.539771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.540261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.541003 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.542203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:21.542746 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:21.544906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:21.551519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3d9d-8f3a-4f9b-a782-e54d76c58995 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.552238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3d9d-8f3a-4f9b-a782-e54d76c58995 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.552238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3d9d-8f3a-4f9b-a782-e54d76c58995 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.554256 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 529/1031] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:21.560098 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beedf60-3287-4ae1-847e-6ee1fa96ee8a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.560536 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beedf60-3287-4ae1-847e-6ee1fa96ee8a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.560685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beedf60-3287-4ae1-847e-6ee1fa96ee8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.572738 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 503/1032] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:21.579464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:21.587616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0beedf60-3287-4ae1-847e-6ee1fa96ee8a None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:21.588856 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0beedf60-3287-4ae1-847e-6ee1fa96ee8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:21.689722 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 530/1033] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:34:21.691916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284be98-0e8a-4a9d-80b6-834a271792ba None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.692418 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284be98-0e8a-4a9d-80b6-834a271792ba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.692908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284be98-0e8a-4a9d-80b6-834a271792ba None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.695963 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 531/1034] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:21.704243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f054-0475-468d-9b3a-b2e2b449befa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.704740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f054-0475-468d-9b3a-b2e2b449befa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.705241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f054-0475-468d-9b3a-b2e2b449befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.722489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44200a68-f7d4-487e-994b-eddd9c5c4826 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:21.735653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e840f054-0475-468d-9b3a-b2e2b449befa None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:21.738043 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e840f054-0475-468d-9b3a-b2e2b449befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:21.748606 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:21.762616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:21.763351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.763627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.763909 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.772621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:21.774151 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:34:21.786921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:21.789238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:21.791900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 504/1035] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:21.795045 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:21.841792 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 532/1036] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:34:21.904811 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84a10-2e1c-48a3-ac7b-8dda09f37f64 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:21.943297 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:21.943951 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:21.944226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:21.944492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:21.945183 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:21.945480 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:21.946964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:21.960903 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 505/1037] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:21.966896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f054-0475-468d-9b3a-b2e2b449befa None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:22.036377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:22.052513 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:22.107290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f054-0475-468d-9b3a-b2e2b449befa None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:22.139467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:22.154432 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:22.155211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:22.155588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:22.155990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:22.156976 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] RBAC: Adding query filter params (role.id=b16955a423c44c50bc478654a9c86233, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=94bfeac1fea64803913036131d3bc6f5) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:22.157451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:22.159240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:22.168486 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 533/1038] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:21 2022] GET /identity/v3/role_assignments?user.id=94bfeac1fea64803913036131d3bc6f5&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b16955a423c44c50bc478654a9c86233 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:22.169925 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:22.219543 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe06df-43e7-4901-915e-2455f74236d0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:22.279046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:22.280161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:22.280655 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:22.281135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] PATH_INFO: `/v3/services/image` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:22.282220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:22.284703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:22.302234 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:22.303423 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:22.304283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:22.305213 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 506/1039] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Sep 22 02:34:22 2022] GET /identity/v3/services/image => generated 86 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:22.311315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:22.338016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d316a3-ab12-4303-a572-8ff265343ace None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:22.355524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:22.409780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:22.409780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:22.409780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:22.409780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:22.410233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:22.410233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:22.410681 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 534/1040] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:22.417267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:22.453243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d8980-9a9f-4e1b-b185-a516af111830 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:22.465405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:22.499818 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:22.500452 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:22.500786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:22.500974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:22.501627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] RBAC: Adding query filter params (name=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:22.501981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:22.503375 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:22.509487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 507/1041] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:22.518185 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:22.558025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b07b68-a066-49b8-86fe-426ce13ba5ea None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:22.631299 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:22.632270 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:22.632659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:22.633317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:22.633763 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:22.635216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:22.670239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 535/1042] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:34:22 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:34:22.672930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91360d-b121-404a-af65-38d67e0ad2da None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:22.723993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:22.725534 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:22.725752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:22.725899 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:22.726554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] RBAC: Adding query filter params (type=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:22.726907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:22.728360 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:22.734820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 508/1043] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:22.741434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:22.784553 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:22.891984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b110c5-4808-48e4-b256-cfa9985f6b8a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:22.937907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689ad86-6cfe-4bd6-88ae-5d70e036ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:22.938658 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689ad86-6cfe-4bd6-88ae-5d70e036ab11 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:22.938944 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689ad86-6cfe-4bd6-88ae-5d70e036ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:22.939273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689ad86-6cfe-4bd6-88ae-5d70e036ab11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:22.940143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689ad86-6cfe-4bd6-88ae-5d70e036ab11 None admin] RBAC: Adding query filter params (interface=public, service_id=405663a52a244fd9816c006d730de555, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:22.940530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689ad86-6cfe-4bd6-88ae-5d70e036ab11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:22.942244 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689ad86-6cfe-4bd6-88ae-5d70e036ab11 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:22.949088 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 536/1044] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:34:22 2022] GET /identity/v3/endpoints?service_id=405663a52a244fd9816c006d730de555&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:22.955150 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:23.008319 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:23.109265 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095fcc-737e-4a4c-b32a-aa349b129c0c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:23.161518 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497ff57-c3d5-4ddb-bdf0-15f5fcd7b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:23.162688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497ff57-c3d5-4ddb-bdf0-15f5fcd7b391 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:23.163133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497ff57-c3d5-4ddb-bdf0-15f5fcd7b391 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:23.163804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497ff57-c3d5-4ddb-bdf0-15f5fcd7b391 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:23.164726 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497ff57-c3d5-4ddb-bdf0-15f5fcd7b391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:23.166644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497ff57-c3d5-4ddb-bdf0-15f5fcd7b391 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:23.181285 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 509/1045] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:34:22 2022] GET /identity/v3/services => generated 1957 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:34:24.488647 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87a26d-0a44-4262-9faa-3ea0f543d924 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:24.489423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87a26d-0a44-4262-9faa-3ea0f543d924 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:24.489423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87a26d-0a44-4262-9faa-3ea0f543d924 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:24.491206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 537/1046] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:24.497370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7875c-227b-475f-bfee-822b8ad84862 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:24.497966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7875c-227b-475f-bfee-822b8ad84862 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:24.497966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7875c-227b-475f-bfee-822b8ad84862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:24.523573 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-88f7875c-227b-475f-bfee-822b8ad84862 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:24.524993 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-88f7875c-227b-475f-bfee-822b8ad84862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:24.625032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 510/1047] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:25.000520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91c38e-a972-4028-b54c-9bc9eb9828ab None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.000912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91c38e-a972-4028-b54c-9bc9eb9828ab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.001309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91c38e-a972-4028-b54c-9bc9eb9828ab None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.002860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 538/1048] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:25.009400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f74b1d-d65d-43bb-bff5-0be95c90839f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.009786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f74b1d-d65d-43bb-bff5-0be95c90839f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.010036 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f74b1d-d65d-43bb-bff5-0be95c90839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.029885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e3f74b1d-d65d-43bb-bff5-0be95c90839f None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:25.031139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e3f74b1d-d65d-43bb-bff5-0be95c90839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:25.032196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91c38e-a972-4028-b54c-9bc9eb9828ab None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.062202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:25.135277 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 511/1049] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:25.163538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:25.173639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91c38e-a972-4028-b54c-9bc9eb9828ab None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:25.220409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:25.221245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.221538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.221951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.237877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:25.244624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:25.246794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:25.248497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:25.251678 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 539/1050] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:25.252856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f74b1d-d65d-43bb-bff5-0be95c90839f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.379792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f74b1d-d65d-43bb-bff5-0be95c90839f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:25.437968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:25.438353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.438994 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.439473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.439911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.441109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:25.441560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:25.443938 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:25.459581 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 512/1051] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:25.465301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.494042 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:25.593558 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f174c6-5173-4281-84ac-c4ea86440dc8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:25.612352 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6231fa-80fd-4674-abd2-e4b230b099ce None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:25.646595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aecf2-a19b-4539-92fa-d759fa04e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:25.647800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aecf2-a19b-4539-92fa-d759fa04e056 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.648145 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aecf2-a19b-4539-92fa-d759fa04e056 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.648836 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aecf2-a19b-4539-92fa-d759fa04e056 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.657829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ae06e-8063-4afe-b656-ff5a0f242eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:25.658473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ae06e-8063-4afe-b656-ff5a0f242eb7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.658753 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ae06e-8063-4afe-b656-ff5a0f242eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.659029 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ae06e-8063-4afe-b656-ff5a0f242eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.663902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aecf2-a19b-4539-92fa-d759fa04e056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-315aecf2-a19b-4539-92fa-d759fa04e056 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:25.670084 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:25.671086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:25.672207 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:25.672991 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ae06e-8063-4afe-b656-ff5a0f242eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:25.673770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 540/1052] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:25.673770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372c79-78f3-462f-a3dc-ad129543d792 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.674037 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ae06e-8063-4afe-b656-ff5a0f242eb7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:25.674170 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372c79-78f3-462f-a3dc-ad129543d792 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.674170 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372c79-78f3-462f-a3dc-ad129543d792 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.674620 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 541/1053] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:25.679468 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372c79-78f3-462f-a3dc-ad129543d792 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-933ae06e-8063-4afe-b656-ff5a0f242eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:25.690280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:25.691791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:25.694105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:25.694105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:25.694105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:25.694105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 513/1054] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:25.694105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b218-c9d2-4b41-8006-4a358574afaa None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.694105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b218-c9d2-4b41-8006-4a358574afaa None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.694105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b218-c9d2-4b41-8006-4a358574afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.710785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:25.711407 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3311b218-c9d2-4b41-8006-4a358574afaa None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:25.712897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3311b218-c9d2-4b41-8006-4a358574afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:25.780715 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 514/1055] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:25.781912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b218-c9d2-4b41-8006-4a358574afaa None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.785124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:25.835212 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372c79-78f3-462f-a3dc-ad129543d792 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:25.871429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:25.871958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.872247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.872521 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.873500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:25.873500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:25.874880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:25.884846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 542/1056] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:25.890325 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.895558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b218-c9d2-4b41-8006-4a358574afaa None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:25.933269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:25.933912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:25.934190 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:25.934467 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:25.935115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:25.935418 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:25.936794 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:25.949190 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 515/1057] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:25.957131 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:25.984895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.010041 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea835e9-3d58-419d-bcb5-7d1c202a21fb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.035370 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.052357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.053518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.053846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.054122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] PATH_INFO: `/v3/users/7539fb424c4f459caf56a99b46017649` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.070848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] RBAC: Authorizing `identity:get_user(user_id=7539fb424c4f459caf56a99b46017649)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.072280 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.074180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 543/1058] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/users/7539fb424c4f459caf56a99b46017649 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:26.078605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7d87a-315f-4b39-9c7d-584a3efc15be None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.080912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.115098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.116301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.116588 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.116857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.125213 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.126621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:34:26.140569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:26.141720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:34:26.142855 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:26.144739 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 516/1059] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:34:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:26.150718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.192482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60c026-70a8-403d-9efb-06a44f2912f1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.230793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.231411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.231812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.232087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.235949 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.255497 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0692ce-bb23-41bf-902a-a0884fba0359 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.279271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.291933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.292552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.292830 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.293106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.293867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:26.294173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.295604 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.319271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 517/1060] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:26.319271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.319556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.320259 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.420166 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a004d-c4fe-42b7-ad99-7c50f223f11c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.455107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.455733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.456009 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.456305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.456873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.458267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.462783 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 544/1061] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:34:26.467974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:26.469346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:26.470547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:26.471414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 518/1062] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:26.472651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.506982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.526067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.579630 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b3e0-aa53-41fa-8487-cb588be74bd8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.589871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a26fb-4e22-459e-850e-5c4b84f133b5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.617338 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.618019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.618312 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.618583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.629822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.630335 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.631043 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.631269 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.631406 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.631744 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.632911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.634735 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.636438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 519/1063] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:26.637298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:26.656079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:26.657155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:26.663914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:26.663914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:26.663914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:26.663914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 545/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:26.663914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.759267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.759852 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2235cb-5f75-49af-a6c9-ce02c9caed45 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.773132 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fce82d-7db6-4865-98ef-73d11e6271d2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.776653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:26.803870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.804476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.804756 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.805026 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.805679 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] RBAC: Adding query filter params (name=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:26.805991 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.807349 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.811822 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:26.812332 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 520/1065] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:26.812487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:26.812748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:26.812982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:26.813130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.813734 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd, user.id=7539fb424c4f459caf56a99b46017649) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:26.814059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:26.815473 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:26.821362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 546/1066] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/role_assignments?user.id=7539fb424c4f459caf56a99b46017649&scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:26.822251 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:26.982136 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987369d6-050a-4eaf-abf1-ff0363482e0e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:26.982547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefd40-570f-4d8e-98f7-4d5402b7c976 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:27.043527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:27.044323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:27.044799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:27.045223 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:27.046476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:27.046980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:27.049142 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:27.055646 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:27.056610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:27.057076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:27.057545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:27.058676 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:27.059195 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:27.061609 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:27.076401 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 521/1067] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:27.076609 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 547/1068] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:27.077577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:27.079268 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:27.109492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:27.147103 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:27.235793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d96be1-4133-437e-a36b-6ac37e01c5d8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:27.240933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1a2b6-3efb-40b7-92fa-12cafe76c771 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:27.283671 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:27.283922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:27.284612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:27.284903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:27.285091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:27.285357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:27.285530 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:27.285837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:27.286650 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:27.288922 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:27.297873 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:27.300267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:34:27.317375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:27.318960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:27.319940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:27.321831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 548/1069] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:27.325720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 522/1070] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:34:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:27.330958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:27.429326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:27.459700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d3948-459a-462b-887d-7d84872093c1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:27.511441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb2bc4-41ef-42e2-9c81-10a9165ce0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:27.512315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2bc4-41ef-42e2-9c81-10a9165ce0bf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:27.512688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2bc4-41ef-42e2-9c81-10a9165ce0bf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:27.513045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2bc4-41ef-42e2-9c81-10a9165ce0bf None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:27.513912 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb2bc4-41ef-42e2-9c81-10a9165ce0bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:27.514377 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb2bc4-41ef-42e2-9c81-10a9165ce0bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:27.516783 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb2bc4-41ef-42e2-9c81-10a9165ce0bf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:27.535812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 549/1071] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:27.545504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:27.699697 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:27.712410 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f366b-f54f-4c7d-a423-05bd7b503ce8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:27.758628 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba38dd1-55ae-4ebb-a137-fad7a2c5a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:27.759296 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba38dd1-55ae-4ebb-a137-fad7a2c5a393 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:27.759577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba38dd1-55ae-4ebb-a137-fad7a2c5a393 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:27.759846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba38dd1-55ae-4ebb-a137-fad7a2c5a393 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/94bfeac1fea64803913036131d3bc6f5/roles/b16955a423c44c50bc478654a9c86233` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:27.762099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba38dd1-55ae-4ebb-a137-fad7a2c5a393 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=94bfeac1fea64803913036131d3bc6f5, role_id=b16955a423c44c50bc478654a9c86233)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:27.763533 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba38dd1-55ae-4ebb-a137-fad7a2c5a393 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:27.784091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 523/1072] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:34:27 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/94bfeac1fea64803913036131d3bc6f5/roles/b16955a423c44c50bc478654a9c86233 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:34:29.123942 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074fcb-411d-4602-9833-2437ef6f941a None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:29.124522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074fcb-411d-4602-9833-2437ef6f941a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:29.124522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074fcb-411d-4602-9833-2437ef6f941a None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:29.126074 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 550/1073] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:29.131574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb7c1-f513-4c8d-b244-9caf6857516e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:29.132105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb7c1-f513-4c8d-b244-9caf6857516e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:29.132105 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb7c1-f513-4c8d-b244-9caf6857516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:29.151214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b0cdb7c1-f513-4c8d-b244-9caf6857516e None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:29.152311 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b0cdb7c1-f513-4c8d-b244-9caf6857516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:29.228041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 524/1074] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:29.499537 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074fcb-411d-4602-9833-2437ef6f941a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:29.645806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074fcb-411d-4602-9833-2437ef6f941a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:29.680780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:29.688102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:29.688927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:29.689346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:29.689791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:29.701880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:29.706745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:29.708305 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:29.710491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:29.713766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 551/1075] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:29.714600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdb7c1-f513-4c8d-b244-9caf6857516e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:29.812253 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:29.833288 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdb7c1-f513-4c8d-b244-9caf6857516e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:29.870440 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8c371-a8f4-41c5-b0ff-3685dcceac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:29.871043 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8c371-a8f4-41c5-b0ff-3685dcceac68 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:29.871323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8c371-a8f4-41c5-b0ff-3685dcceac68 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:29.871582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8c371-a8f4-41c5-b0ff-3685dcceac68 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:29.872246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8c371-a8f4-41c5-b0ff-3685dcceac68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:29.872540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8c371-a8f4-41c5-b0ff-3685dcceac68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:29.873936 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8c371-a8f4-41c5-b0ff-3685dcceac68 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:29.887925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 525/1076] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:29.889514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:29.916787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1377-f930-45af-87e9-c46dd63ded8f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:29.917077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1377-f930-45af-87e9-c46dd63ded8f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:29.917367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1377-f930-45af-87e9-c46dd63ded8f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:29.918825 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 526/1077] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:29.924751 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de0f3-943a-435d-9731-8192ec5e6d4d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:29.925032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de0f3-943a-435d-9731-8192ec5e6d4d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:29.925309 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de0f3-943a-435d-9731-8192ec5e6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:29.950782 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2b1de0f3-943a-435d-9731-8192ec5e6d4d None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:29.951987 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2b1de0f3-943a-435d-9731-8192ec5e6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:30.009164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4c1cf-1813-419b-958a-3db3174a6603 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:30.031226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 527/1078] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:30.032920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee131b8-ec24-48ce-b5a2-1f1b2b1d920e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:30.033204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee131b8-ec24-48ce-b5a2-1f1b2b1d920e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:30.033484 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee131b8-ec24-48ce-b5a2-1f1b2b1d920e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:30.034955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 528/1079] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:30.041230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3157-9517-40b9-9d6b-69a7b62a78a4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:30.041507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3157-9517-40b9-9d6b-69a7b62a78a4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:30.041811 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3157-9517-40b9-9d6b-69a7b62a78a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:30.049936 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:30.051160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:30.051547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:30.051927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] PATH_INFO: `/v3/users/7539fb424c4f459caf56a99b46017649` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:30.054094 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] RBAC: Authorizing `identity:get_user(user_id=7539fb424c4f459caf56a99b46017649)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:30.056522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:30.061709 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 552/1080] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:29 2022] GET /identity/v3/users/7539fb424c4f459caf56a99b46017649 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:30.066153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:30.068924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a96b3157-9517-40b9-9d6b-69a7b62a78a4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:30.070791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a96b3157-9517-40b9-9d6b-69a7b62a78a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:30.154593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:30.177130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 529/1081] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:34:30.227416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61eea6b-c4d0-44af-b875-dd641b9b7a6f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:30.286092 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:30.287188 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:30.287633 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:30.288104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:30.290197 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:30.293031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:30.301902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 553/1082] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:30 2022] GET /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd => generated 311 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:30.303639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3157-9517-40b9-9d6b-69a7b62a78a4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:30.314597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:30.326675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:30.440600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3157-9517-40b9-9d6b-69a7b62a78a4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:30.502609 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:30.503664 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:30.504130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:30.504561 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd/users/7539fb424c4f459caf56a99b46017649/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:30.508334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd, user_id=7539fb424c4f459caf56a99b46017649, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:30.510920 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:30.512230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2334919-c327-41c4-80d0-19160a9ec920 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:30.532877 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 530/1083] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:34:30 2022] PUT /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd/users/7539fb424c4f459caf56a99b46017649/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:34:30.546334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:30.562127 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:30.577967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:30.578711 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:30.579169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:30.579618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:30.650222 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:30.675665 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:30.677217 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:30.700255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70bb4d-a85a-45df-b340-7338ed1b9e01 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:30.786892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:30.788337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:30.788844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:30.789322 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:30.810580 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:30.813307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 554/1084] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 02:34:30.820851 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:30.821027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:30.821983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 02:34:30.822831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:30.823475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 531/1085] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 22 02:34:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:30.831743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:30.858903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:30.965355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf65c-5759-46c0-8f87-1d43f9d9f196 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:30.989339 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297edd5c-bfc0-48d4-a4ae-46bf010f17c6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:31.018685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:31.019525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:31.019971 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:31.020376 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:31.030216 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:31.036189 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:31.039834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:31.046377 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:31.047321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:31.047760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:31.048198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:31.049320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:31.049850 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:31.052757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:31.062960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 532/1086] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 22 02:34:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:31.063845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:31.065574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:31.067388 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:31.067388 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:31.067388 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:31.069862 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 555/1087] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:31.071775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:31.073359 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:31.194152 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:31.213400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24fb2-18de-4433-815b-4f294322c114 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:31.217134 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f471ced-e845-4a3a-b1fa-67f0f646a9d0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:31.254343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:31.255093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:31.255443 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:31.255872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:31.267852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:31.269310 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:31.270814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:31.272218 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:31.272716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:31.273229 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:31.274413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:31.275857 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:31.277694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:31.286593 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:31.287725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:31.288639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:31.288639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:31.288639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:31.288639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 556/1088] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:31.294413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:31.301935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 533/1089] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:31.440282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96dab0-86b0-4f11-8687-3fd719bd630b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:31.500803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:31.511728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:31.512721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:31.513183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:31.513644 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:31.514834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:31.515435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:31.518026 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:31.542598 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 557/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:31.550077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:31.628663 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:31.715223 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ef3b-77b9-4255-a955-61a5b13485d5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:31.773202 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:31.774217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:31.774708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:31.775203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:31.788486 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:31.791471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:34:31.805555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:31.806642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:31.807566 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 534/1091] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 22 02:34:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:31.812652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:31.972389 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cad8b-4d3a-464f-bfa5-503e39cccde9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:32.022670 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:32.023435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:32.023721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:32.024057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:32.024856 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:32.025223 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:32.026860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:32.046273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 558/1092] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 22 02:34:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:32.052231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:32.174606 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b6cc-b073-4553-a83c-350b6782e3b7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:32.186456 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:32.218846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:32.219556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:32.219747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:32.220020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:32.301636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:32.304006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:32.422333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 535/1093] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 02:34:32.429352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:32.481803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:32.532673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ce70-af66-4c30-84f3-8d33dd45577e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:32.576284 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e6567-a5c9-4241-a7ed-fc30cd121915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:32.576989 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e6567-a5c9-4241-a7ed-fc30cd121915 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:32.577264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e6567-a5c9-4241-a7ed-fc30cd121915 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:32.577534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e6567-a5c9-4241-a7ed-fc30cd121915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:32.592162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e6567-a5c9-4241-a7ed-fc30cd121915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:32.593598 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e6567-a5c9-4241-a7ed-fc30cd121915 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b95e6567-a5c9-4241-a7ed-fc30cd121915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:34:32.608757 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:32.609842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:34:32.610875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:34:32.610875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:34:32.610875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:32.610875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 559/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:32.615777 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:32.626796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:32.736156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb79914-c72a-4092-b99f-73468e3d8c87 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:32.774897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:32.775510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:32.775786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:32.776052 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:32.776691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:32.776990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:32.778402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:32.786783 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521082a-598e-4017-a249-c23d7b88283c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:32.787097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521082a-598e-4017-a249-c23d7b88283c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:32.787374 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521082a-598e-4017-a249-c23d7b88283c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:32.788730 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 560/1095] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:34:32.791263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 536/1096] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:32.795225 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16530c82-cfa3-4386-bac1-28d00752d938 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:32.795566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16530c82-cfa3-4386-bac1-28d00752d938 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:32.795859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16530c82-cfa3-4386-bac1-28d00752d938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:32.797199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:32.814756 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-16530c82-cfa3-4386-bac1-28d00752d938 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:32.815993 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-16530c82-cfa3-4386-bac1-28d00752d938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:32.888250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 561/1097] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:32.888438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:32.925626 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfaf91-287f-42e3-8d76-229cc44309ed None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:32.962459 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:32.963085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:32.963369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:32.963642 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:32.970806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:32.972258 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:34:32.984988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:32.986107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:34:32.987402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 537/1098] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:34:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:32.992873 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16530c82-cfa3-4386-bac1-28d00752d938 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:33.026205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:33.102294 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16530c82-cfa3-4386-bac1-28d00752d938 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:33.139081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:33.140951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:33.140951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:33.140951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:33.140951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:33.141280 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:33.142599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:33.155015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 562/1099] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:34:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:33.161192 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:33.161398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:33.273870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:33.280184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619d06c-f1f1-4b9a-8c9c-c2815a5f4982 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:33.283616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c2f7-7fe3-4d99-8908-ca2e124e622c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:33.309479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:33.318894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:33.319450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:33.319617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:33.319766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:33.319988 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:33.320208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:33.320482 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:33.320716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] RBAC: Adding query filter params (role.id=b16955a423c44c50bc478654a9c86233, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=94bfeac1fea64803913036131d3bc6f5) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:33.320855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:33.321024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:33.322514 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:33.328668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 538/1100] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:33 2022] GET /identity/v3/role_assignments?user.id=94bfeac1fea64803913036131d3bc6f5&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b16955a423c44c50bc478654a9c86233 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:33.332809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:33.338410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:33.339575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:33.340433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 563/1101] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:34:33.346084 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:33.479856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8086c-0f2b-415c-ac85-328b51da77be None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:33.532433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:33.533052 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:33.533333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:33.533608 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:33.534323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:33.534626 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:33.536007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:33.546360 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 539/1102] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:33.552680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:33.677435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0bcd8-237b-47bd-b46b-9ec16bb42aef None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:33.712711 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:33.713356 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:33.713634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:33.713954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] PATH_INFO: `/v3/users/7539fb424c4f459caf56a99b46017649` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:33.715115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] RBAC: Authorizing `identity:get_user(user_id=7539fb424c4f459caf56a99b46017649)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:33.716551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:33.719015 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 564/1103] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:33 2022] GET /identity/v3/users/7539fb424c4f459caf56a99b46017649 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:33.724301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:33.789021 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:33.841221 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad853d66-4f33-4bae-a406-5ada50ccb5ad None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:33.882355 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:33.883004 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:33.883292 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:33.883561 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:33.960409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:33.961900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:34.020842 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:34.072025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 540/1104] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:34:34.078292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:34.106371 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:34.191412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fbe64-bdcf-447f-bfc3-871b71d15c5a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:34.229591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541628ec-7ff9-4da5-9186-f59bf4d18625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:34.230728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541628ec-7ff9-4da5-9186-f59bf4d18625 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:34.230728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541628ec-7ff9-4da5-9186-f59bf4d18625 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:34.230941 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541628ec-7ff9-4da5-9186-f59bf4d18625 None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:34.231969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541628ec-7ff9-4da5-9186-f59bf4d18625 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:34.233404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541628ec-7ff9-4da5-9186-f59bf4d18625 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:34.236217 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 565/1105] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:34 2022] GET /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:34.242141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:34.351124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2f98-659a-47e5-bd37-a3adb65e1581 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:34.385442 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e98ebb-cb27-4c66-8f8d-8c1c184b9728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:34.386075 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e98ebb-cb27-4c66-8f8d-8c1c184b9728 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:34.386356 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e98ebb-cb27-4c66-8f8d-8c1c184b9728 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:34.386629 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e98ebb-cb27-4c66-8f8d-8c1c184b9728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:34.387351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e98ebb-cb27-4c66-8f8d-8c1c184b9728 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd, user.id=7539fb424c4f459caf56a99b46017649) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:34.387658 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e98ebb-cb27-4c66-8f8d-8c1c184b9728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:34.389081 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e98ebb-cb27-4c66-8f8d-8c1c184b9728 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:34.395057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 541/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:34 2022] GET /identity/v3/role_assignments?user.id=7539fb424c4f459caf56a99b46017649&scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:36.679682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd12a8-088c-4cf2-8ba1-b0c58658f616 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:36.680205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd12a8-088c-4cf2-8ba1-b0c58658f616 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:36.680205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd12a8-088c-4cf2-8ba1-b0c58658f616 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:36.681559 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 566/1107] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:36.686975 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ccbd-18d3-45c5-9783-c51c036af6eb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:36.687388 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ccbd-18d3-45c5-9783-c51c036af6eb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:36.687523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ccbd-18d3-45c5-9783-c51c036af6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:36.706007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9fa0ccbd-18d3-45c5-9783-c51c036af6eb None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:36.707204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9fa0ccbd-18d3-45c5-9783-c51c036af6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:36.720269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:36.773430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 542/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:37.039722 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd12a8-088c-4cf2-8ba1-b0c58658f616 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:37.133834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:37.147118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd12a8-088c-4cf2-8ba1-b0c58658f616 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:37.179698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb46d3-b8cb-4d57-83a9-efd39dfde818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:37.180323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb46d3-b8cb-4d57-83a9-efd39dfde818 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:37.180603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb46d3-b8cb-4d57-83a9-efd39dfde818 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:37.180872 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb46d3-b8cb-4d57-83a9-efd39dfde818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:37.181998 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb46d3-b8cb-4d57-83a9-efd39dfde818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:37.183404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb46d3-b8cb-4d57-83a9-efd39dfde818 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:37.184991 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 567/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:37.190761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0ccbd-18d3-45c5-9783-c51c036af6eb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:37.288154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0ccbd-18d3-45c5-9783-c51c036af6eb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:37.320396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856675f-9511-4038-8d9f-068b118681d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:37.320926 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856675f-9511-4038-8d9f-068b118681d1 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:37.321200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856675f-9511-4038-8d9f-068b118681d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:37.321468 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856675f-9511-4038-8d9f-068b118681d1 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:37.322148 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856675f-9511-4038-8d9f-068b118681d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:37.323551 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856675f-9511-4038-8d9f-068b118681d1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:37.346596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 543/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:34:37 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:39.548243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad546b-c1aa-422d-81c0-7da353bbb55d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:39.548782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad546b-c1aa-422d-81c0-7da353bbb55d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:39.548782 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad546b-c1aa-422d-81c0-7da353bbb55d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:39.550275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 568/1111] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:39.555695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c445434-145a-4309-9a49-1d289c5176fa None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:39.556125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c445434-145a-4309-9a49-1d289c5176fa None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:39.556217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c445434-145a-4309-9a49-1d289c5176fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:39.563387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:39.577862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7c445434-145a-4309-9a49-1d289c5176fa None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:39.579051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7c445434-145a-4309-9a49-1d289c5176fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:39.646907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 544/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:39.928491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad546b-c1aa-422d-81c0-7da353bbb55d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:40.039932 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad546b-c1aa-422d-81c0-7da353bbb55d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:40.075735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:40.076364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:40.076640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:40.076907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] PATH_INFO: `/v3/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:40.078312 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] RBAC: Authorizing `identity:get_role(role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:40.079661 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:40.080988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 569/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:39 2022] GET /identity/v3/roles/80756a2a2a9a47918e65c4ed873146eb => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:40.087562 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c445434-145a-4309-9a49-1d289c5176fa None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:40.185915 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c445434-145a-4309-9a49-1d289c5176fa None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:40.218972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:40.219598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:40.219876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:40.220144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] PATH_INFO: `/v3/users/abcae1969c5049cda691d12f9f378be0` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:40.222041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:40.234446 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] RBAC: Authorizing `identity:get_user(user_id=abcae1969c5049cda691d12f9f378be0)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:40.235876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:40.237505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 545/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:40 2022] GET /identity/v3/users/abcae1969c5049cda691d12f9f378be0 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:40.243845 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:40.269239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:40.341851 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42129b-67d0-464e-962f-0f5036241858 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:40.374060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:40.374656 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:40.374930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:40.375198 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:40.440003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:40.441332 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:40.464427 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:40.535020 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 570/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:34:40.541775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:40.638013 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5429d-acba-447c-ab91-620d1e62f030 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:40.671560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76151d-69b6-4501-8988-dc274ca1bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:40.672178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76151d-69b6-4501-8988-dc274ca1bf1c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:40.672452 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76151d-69b6-4501-8988-dc274ca1bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:40.672718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76151d-69b6-4501-8988-dc274ca1bf1c None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:40.673840 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76151d-69b6-4501-8988-dc274ca1bf1c None admin] RBAC: Authorizing `identity:get_project(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:40.675255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76151d-69b6-4501-8988-dc274ca1bf1c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:40.676867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 546/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:40 2022] GET /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:40.683698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:40.778671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d822fdd-067f-478c-84d0-5e3cab2696f5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:40.801094 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:40.815277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf5190-67a5-463d-a273-d44052668c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:40.815904 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf5190-67a5-463d-a273-d44052668c79 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:40.816187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf5190-67a5-463d-a273-d44052668c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:40.816462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf5190-67a5-463d-a273-d44052668c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:40.817210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf5190-67a5-463d-a273-d44052668c79 None admin] RBAC: Adding query filter params (role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd, user.id=abcae1969c5049cda691d12f9f378be0) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:40.817522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf5190-67a5-463d-a273-d44052668c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:40.819682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf5190-67a5-463d-a273-d44052668c79 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:40.825712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 571/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:40 2022] GET /identity/v3/role_assignments?user.id=abcae1969c5049cda691d12f9f378be0&scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:42.948070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29646e-fb70-4337-87bd-569be1c65ae0 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:42.948620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29646e-fb70-4337-87bd-569be1c65ae0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:42.948620 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29646e-fb70-4337-87bd-569be1c65ae0 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:42.949959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 547/1118] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:42.955606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c0606-7a18-4df3-813b-54006848e189 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:42.956041 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c0606-7a18-4df3-813b-54006848e189 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:42.956150 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c0606-7a18-4df3-813b-54006848e189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:42.973874 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-214c0606-7a18-4df3-813b-54006848e189 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:42.975559 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-214c0606-7a18-4df3-813b-54006848e189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:43.043881 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 572/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:43.313085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29646e-fb70-4337-87bd-569be1c65ae0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:43.371652 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:43.412612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29646e-fb70-4337-87bd-569be1c65ae0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:43.445180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:43.445822 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:43.446097 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:43.446362 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] PATH_INFO: `/v3/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:43.447725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] RBAC: Authorizing `identity:get_role(role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:43.449068 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:43.450395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 548/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:43 2022] GET /identity/v3/roles/80756a2a2a9a47918e65c4ed873146eb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:34:43.456435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c0606-7a18-4df3-813b-54006848e189 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:43.552283 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c0606-7a18-4df3-813b-54006848e189 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:43.569137 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:43.586781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:43.587407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:43.587684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:43.587953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] PATH_INFO: `/v3/users/abcae1969c5049cda691d12f9f378be0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:43.589059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] RBAC: Authorizing `identity:get_user(user_id=abcae1969c5049cda691d12f9f378be0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:43.590496 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:43.592064 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 573/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:43 2022] GET /identity/v3/users/abcae1969c5049cda691d12f9f378be0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:43.597949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:43.697368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b215-c41a-4f3a-a005-11816b1ffb92 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:43.724430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:43.732291 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da1f17-dffb-4c18-ae5f-6c5a700edad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:43.732911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1f17-dffb-4c18-ae5f-6c5a700edad5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:43.733185 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1f17-dffb-4c18-ae5f-6c5a700edad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:43.733453 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1f17-dffb-4c18-ae5f-6c5a700edad5 None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:43.734587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da1f17-dffb-4c18-ae5f-6c5a700edad5 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:43.735994 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da1f17-dffb-4c18-ae5f-6c5a700edad5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:43.737601 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 549/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:43 2022] GET /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:43.743596 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:43.839586 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fb6f8-0d21-4a70-95a7-e8e68835ce75 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:43.873103 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c51c0-4fb4-4b54-9a4f-c0b380f718f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:43.873770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c51c0-4fb4-4b54-9a4f-c0b380f718f3 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:43.874049 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c51c0-4fb4-4b54-9a4f-c0b380f718f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:43.874326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c51c0-4fb4-4b54-9a4f-c0b380f718f3 None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd/users/abcae1969c5049cda691d12f9f378be0/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:43.876428 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c51c0-4fb4-4b54-9a4f-c0b380f718f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd, user_id=abcae1969c5049cda691d12f9f378be0, role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:43.877859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c51c0-4fb4-4b54-9a4f-c0b380f718f3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:43.890953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 574/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:34:43 2022] PUT /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd/users/abcae1969c5049cda691d12f9f378be0/roles/80756a2a2a9a47918e65c4ed873146eb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:34:46.085898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3c974-f266-4dc3-b631-977506b3c2cd None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:46.086444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3c974-f266-4dc3-b631-977506b3c2cd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:46.086444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3c974-f266-4dc3-b631-977506b3c2cd None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:46.087765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 550/1124] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:46.093716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512026f8-3ae6-43cb-abde-9cab07e69724 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:46.094192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512026f8-3ae6-43cb-abde-9cab07e69724 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:46.094285 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512026f8-3ae6-43cb-abde-9cab07e69724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:46.112102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-512026f8-3ae6-43cb-abde-9cab07e69724 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:46.113296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-512026f8-3ae6-43cb-abde-9cab07e69724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:46.155967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:46.181998 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 575/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:46.455028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3c974-f266-4dc3-b631-977506b3c2cd None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:46.553738 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3c974-f266-4dc3-b631-977506b3c2cd None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:46.586284 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:46.586907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:46.587181 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:46.587451 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] PATH_INFO: `/v3/roles/80756a2a2a9a47918e65c4ed873146eb` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:46.588819 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] RBAC: Authorizing `identity:get_role(role_id=80756a2a2a9a47918e65c4ed873146eb)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:46.590200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:46.591511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 551/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:46 2022] GET /identity/v3/roles/80756a2a2a9a47918e65c4ed873146eb => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:46.597322 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512026f8-3ae6-43cb-abde-9cab07e69724 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:46.695549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512026f8-3ae6-43cb-abde-9cab07e69724 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:46.728886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:46.729637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:46.729946 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:46.730215 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] PATH_INFO: `/v3/users/abcae1969c5049cda691d12f9f378be0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:46.731542 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=abcae1969c5049cda691d12f9f378be0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:46.734177 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:46.736961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 576/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:46 2022] GET /identity/v3/users/abcae1969c5049cda691d12f9f378be0 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:46.743944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:46.806980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:46.844812 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549c6d-3cdf-4d86-ae89-bff95f60279f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:46.877535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:46.878164 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:46.878441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:46.878713 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:46.948767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:46.950243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:47.009504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:47.047914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 552/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 02:34:47.055804 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:47.104534 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:47.157107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358a53-66eb-40b2-bff6-e219bfc48bf8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:47.189561 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb6f5f-b22c-4f0e-aea3-b83657517db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:47.190208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb6f5f-b22c-4f0e-aea3-b83657517db6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:47.190484 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb6f5f-b22c-4f0e-aea3-b83657517db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:47.190753 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb6f5f-b22c-4f0e-aea3-b83657517db6 None admin] PATH_INFO: `/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:47.191849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb6f5f-b22c-4f0e-aea3-b83657517db6 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8a5d0e9d4245b9b5cc301f36278bbd)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:47.193920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb6f5f-b22c-4f0e-aea3-b83657517db6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:47.195537 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 577/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:47 2022] GET /identity/v3/projects/3f8a5d0e9d4245b9b5cc301f36278bbd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:47.201816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:47.297721 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7529f2-daf4-4dc6-9f12-f241ba7dd8d7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:47.330902 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a208868-14b5-4ef7-bee5-ed77c539f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:47.331487 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a208868-14b5-4ef7-bee5-ed77c539f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:47.331762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a208868-14b5-4ef7-bee5-ed77c539f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:47.332030 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a208868-14b5-4ef7-bee5-ed77c539f4b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:47.332743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a208868-14b5-4ef7-bee5-ed77c539f4b9 None admin] RBAC: Adding query filter params (role.id=80756a2a2a9a47918e65c4ed873146eb, scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd, user.id=abcae1969c5049cda691d12f9f378be0) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:47.333045 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a208868-14b5-4ef7-bee5-ed77c539f4b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:47.334482 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a208868-14b5-4ef7-bee5-ed77c539f4b9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:47.340020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 553/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:47 2022] GET /identity/v3/role_assignments?user.id=abcae1969c5049cda691d12f9f378be0&scope.project.id=3f8a5d0e9d4245b9b5cc301f36278bbd&role.id=80756a2a2a9a47918e65c4ed873146eb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:49.548076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503804ab-b1b1-4e99-95e9-3edcec8abbd9 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:49.548713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503804ab-b1b1-4e99-95e9-3edcec8abbd9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:49.548713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503804ab-b1b1-4e99-95e9-3edcec8abbd9 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:49.549987 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 578/1131] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:49.555266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78f14-c82c-48a4-9f31-5ee837a5d1b9 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:49.555675 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78f14-c82c-48a4-9f31-5ee837a5d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:49.555804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78f14-c82c-48a4-9f31-5ee837a5d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:49.574243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fdf78f14-c82c-48a4-9f31-5ee837a5d1b9 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:49.575424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fdf78f14-c82c-48a4-9f31-5ee837a5d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:49.598460 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:49.642018 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 554/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:49.908012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503804ab-b1b1-4e99-95e9-3edcec8abbd9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:50.006853 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503804ab-b1b1-4e99-95e9-3edcec8abbd9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:50.019683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:50.041880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41df25c-0b70-48f2-b5da-f10c419c6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:50.042512 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41df25c-0b70-48f2-b5da-f10c419c6c65 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:50.042790 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41df25c-0b70-48f2-b5da-f10c419c6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:50.043063 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41df25c-0b70-48f2-b5da-f10c419c6c65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:50.044180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41df25c-0b70-48f2-b5da-f10c419c6c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:50.045595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41df25c-0b70-48f2-b5da-f10c419c6c65 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:50.047197 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 579/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:50.053049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78f14-c82c-48a4-9f31-5ee837a5d1b9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:50.151419 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78f14-c82c-48a4-9f31-5ee837a5d1b9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:50.194340 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10e40-78e0-4861-9a43-30d5234e977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:50.194963 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10e40-78e0-4861-9a43-30d5234e977b None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:50.195243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10e40-78e0-4861-9a43-30d5234e977b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:50.195515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10e40-78e0-4861-9a43-30d5234e977b None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:50.196189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf10e40-78e0-4861-9a43-30d5234e977b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:50.197624 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf10e40-78e0-4861-9a43-30d5234e977b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:50.225906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 555/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:34:50 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:52.390446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fc5b-b31a-48d6-bebc-e227e0dc68a3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:52.391086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fc5b-b31a-48d6-bebc-e227e0dc68a3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:52.391086 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fc5b-b31a-48d6-bebc-e227e0dc68a3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:52.392306 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 580/1135] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:52.398669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c13a9-94b7-4938-9d94-510d541a22d6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:52.399122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c13a9-94b7-4938-9d94-510d541a22d6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:52.399220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c13a9-94b7-4938-9d94-510d541a22d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:52.418113 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-df5c13a9-94b7-4938-9d94-510d541a22d6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:52.419299 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-df5c13a9-94b7-4938-9d94-510d541a22d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:52.422101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:52.487404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 556/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:52.759559 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43fc5b-b31a-48d6-bebc-e227e0dc68a3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:52.869859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43fc5b-b31a-48d6-bebc-e227e0dc68a3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:52.905751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95f475-0c3a-44f6-8506-466403fdc6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:52.906395 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f475-0c3a-44f6-8506-466403fdc6db None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:52.906671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f475-0c3a-44f6-8506-466403fdc6db None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:52.906943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f475-0c3a-44f6-8506-466403fdc6db None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:52.908081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95f475-0c3a-44f6-8506-466403fdc6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:52.909503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95f475-0c3a-44f6-8506-466403fdc6db None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:52.911142 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 581/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:34:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:52.917444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c13a9-94b7-4938-9d94-510d541a22d6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:53.025176 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c13a9-94b7-4938-9d94-510d541a22d6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:53.058709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed61e8-c859-403e-8e91-b2a961fbde4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:53.059312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed61e8-c859-403e-8e91-b2a961fbde4d None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:53.059584 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed61e8-c859-403e-8e91-b2a961fbde4d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:53.059848 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed61e8-c859-403e-8e91-b2a961fbde4d None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:53.060497 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed61e8-c859-403e-8e91-b2a961fbde4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:53.061939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed61e8-c859-403e-8e91-b2a961fbde4d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:53.073272 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:53.084489 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 557/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:34:52 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:34:55.273471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a192f-b012-4bb1-87a8-ad2fd07ae956 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:55.274070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a192f-b012-4bb1-87a8-ad2fd07ae956 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:55.274070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a192f-b012-4bb1-87a8-ad2fd07ae956 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:55.275364 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 582/1139] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:55.280592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b440-69f2-49d1-ac77-cb95b5011f88 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:55.280976 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b440-69f2-49d1-ac77-cb95b5011f88 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:55.281149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b440-69f2-49d1-ac77-cb95b5011f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:55.299793 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-84b8b440-69f2-49d1-ac77-cb95b5011f88 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:55.300983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-84b8b440-69f2-49d1-ac77-cb95b5011f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:55.367556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 558/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:55.641289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a192f-b012-4bb1-87a8-ad2fd07ae956 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:55.696655 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:55.750153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a192f-b012-4bb1-87a8-ad2fd07ae956 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:55.786211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:55.786896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:55.787176 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:55.787453 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:55.798634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:55.803539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:55.804605 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:55.805571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 583/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:55.810905 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b440-69f2-49d1-ac77-cb95b5011f88 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:55.911715 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b440-69f2-49d1-ac77-cb95b5011f88 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:55.936916 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:55.946694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:55.947297 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:55.947574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:55.947846 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:55.948507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:55.948809 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:55.950206 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:55.958209 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 559/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:55.964236 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:56.062473 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012151e-7f17-4b95-9ca7-b941d2ca6768 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:56.072079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:56.095935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:56.096559 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:56.096839 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:56.097113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] PATH_INFO: `/v3/users/8f4fc96993bc43e4b49ac71d195d1b71` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:56.109830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=8f4fc96993bc43e4b49ac71d195d1b71)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:56.111262 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:56.112886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 584/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:55 2022] GET /identity/v3/users/8f4fc96993bc43e4b49ac71d195d1b71 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:56.119269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:56.216254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c49e1-7632-4fb3-8783-c742d90e05cc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:56.248703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:56.249333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:56.249631 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:56.249925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:56.303422 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:56.316117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:56.317560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:56.414539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 560/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:34:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:34:56.420829 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:56.516123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a9e79-39a1-4644-9e4e-454a40ca3ad6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:56.549115 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a0c11-2862-4d5c-a524-0a0a1252a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:56.549816 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0c11-2862-4d5c-a524-0a0a1252a338 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:56.550090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0c11-2862-4d5c-a524-0a0a1252a338 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:56.550357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0c11-2862-4d5c-a524-0a0a1252a338 None admin] PATH_INFO: `/v3/projects/230f83d1d8f04f5a9543809988ecf6a8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:56.551525 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a0c11-2862-4d5c-a524-0a0a1252a338 None admin] RBAC: Authorizing `identity:get_project(project_id=230f83d1d8f04f5a9543809988ecf6a8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:56.552964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a0c11-2862-4d5c-a524-0a0a1252a338 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:56.554706 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 585/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:56 2022] GET /identity/v3/projects/230f83d1d8f04f5a9543809988ecf6a8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:56.561261 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:56.647859 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:56.659698 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b704d03-96cd-4c1d-80ce-ab20dda2a533 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:56.692194 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcbfe3-152e-434f-9116-ac533d5a6276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:56.693560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbfe3-152e-434f-9116-ac533d5a6276 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:56.693890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbfe3-152e-434f-9116-ac533d5a6276 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:56.694119 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbfe3-152e-434f-9116-ac533d5a6276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:56.694833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcbfe3-152e-434f-9116-ac533d5a6276 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=230f83d1d8f04f5a9543809988ecf6a8, user.id=8f4fc96993bc43e4b49ac71d195d1b71) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:56.695133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcbfe3-152e-434f-9116-ac533d5a6276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:56.696542 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcbfe3-152e-434f-9116-ac533d5a6276 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:56.701695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 561/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:34:56 2022] GET /identity/v3/role_assignments?user.id=8f4fc96993bc43e4b49ac71d195d1b71&scope.project.id=230f83d1d8f04f5a9543809988ecf6a8&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:58.818387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670eb55-592a-4b09-94af-8bf81801fc08 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:58.818938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670eb55-592a-4b09-94af-8bf81801fc08 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:58.818938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670eb55-592a-4b09-94af-8bf81801fc08 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:58.820240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 586/1147] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:34:58.825535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658db3b-0a1c-4d5b-bd38-63133674edb5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:58.825972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658db3b-0a1c-4d5b-bd38-63133674edb5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:58.826108 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658db3b-0a1c-4d5b-bd38-63133674edb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:58.844474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-5658db3b-0a1c-4d5b-bd38-63133674edb5 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:34:58.845677 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5658db3b-0a1c-4d5b-bd38-63133674edb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:34:58.910372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 562/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:34:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:34:59.179203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670eb55-592a-4b09-94af-8bf81801fc08 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:59.213795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:59.282355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670eb55-592a-4b09-94af-8bf81801fc08 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:59.317077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:59.317766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:59.318049 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:59.318323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:59.328276 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:34:59.333035 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:34:59.334206 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:34:59.335254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 587/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:34:59.340641 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658db3b-0a1c-4d5b-bd38-63133674edb5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:59.429884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:59.449947 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658db3b-0a1c-4d5b-bd38-63133674edb5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:59.485386 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:59.486008 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:59.486282 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:59.486553 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:59.487207 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:34:59.487503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:59.488852 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:59.497300 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 563/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:59.503289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:59.593138 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:34:59.600603 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6cd40-152d-4bb7-a704-d2024bfbd0a5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:59.633601 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:59.634250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:59.634530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:59.634801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] PATH_INFO: `/v3/users/8f4fc96993bc43e4b49ac71d195d1b71` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:59.635907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] RBAC: Authorizing `identity:get_user(user_id=8f4fc96993bc43e4b49ac71d195d1b71)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:59.637319 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:59.638938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 588/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:34:59 2022] GET /identity/v3/users/8f4fc96993bc43e4b49ac71d195d1b71 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:59.644816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:59.744596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033d013-5106-4ffa-81b1-011cc95366bb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:59.777200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803a19-01c8-4aa0-97bd-c38ab40e4b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:59.777874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803a19-01c8-4aa0-97bd-c38ab40e4b8f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:59.778154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803a19-01c8-4aa0-97bd-c38ab40e4b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:59.778424 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803a19-01c8-4aa0-97bd-c38ab40e4b8f None admin] PATH_INFO: `/v3/projects/230f83d1d8f04f5a9543809988ecf6a8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:59.779540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803a19-01c8-4aa0-97bd-c38ab40e4b8f None admin] RBAC: Authorizing `identity:get_project(project_id=230f83d1d8f04f5a9543809988ecf6a8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:59.780955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803a19-01c8-4aa0-97bd-c38ab40e4b8f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:59.782602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 564/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:34:59 2022] GET /identity/v3/projects/230f83d1d8f04f5a9543809988ecf6a8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:34:59.789334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:34:59.890397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0f074-f0e1-4e82-b008-5093944ccf89 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:34:59.925258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8de7f-86c0-4efe-baec-ed36affec778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:34:59.925938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8de7f-86c0-4efe-baec-ed36affec778 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:34:59.926220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8de7f-86c0-4efe-baec-ed36affec778 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:34:59.926494 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8de7f-86c0-4efe-baec-ed36affec778 None admin] PATH_INFO: `/v3/projects/230f83d1d8f04f5a9543809988ecf6a8/users/8f4fc96993bc43e4b49ac71d195d1b71/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:34:59.928405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8de7f-86c0-4efe-baec-ed36affec778 None admin] RBAC: Authorizing `identity:create_grant(project_id=230f83d1d8f04f5a9543809988ecf6a8, user_id=8f4fc96993bc43e4b49ac71d195d1b71, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:34:59.929849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8de7f-86c0-4efe-baec-ed36affec778 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:34:59.943648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 589/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:34:59 2022] PUT /identity/v3/projects/230f83d1d8f04f5a9543809988ecf6a8/users/8f4fc96993bc43e4b49ac71d195d1b71/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:35:02.083136 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abacfe-bc55-476d-a9c1-52d854c92c04 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:02.083719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abacfe-bc55-476d-a9c1-52d854c92c04 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:02.083719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abacfe-bc55-476d-a9c1-52d854c92c04 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:02.085051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 565/1154] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:02.090497 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c15be-f732-4911-a7e0-135ad9215a3f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:02.090922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c15be-f732-4911-a7e0-135ad9215a3f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:02.091043 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c15be-f732-4911-a7e0-135ad9215a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:02.109693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a57c15be-f732-4911-a7e0-135ad9215a3f None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:02.110896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a57c15be-f732-4911-a7e0-135ad9215a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:02.127628 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:02.178965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 590/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:35:02.455480 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abacfe-bc55-476d-a9c1-52d854c92c04 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:02.470606 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:02.556236 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abacfe-bc55-476d-a9c1-52d854c92c04 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:02.589331 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5840de-960c-4851-b54e-73735523578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:02.589994 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5840de-960c-4851-b54e-73735523578f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:02.590270 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5840de-960c-4851-b54e-73735523578f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:02.590538 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5840de-960c-4851-b54e-73735523578f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:02.602108 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5840de-960c-4851-b54e-73735523578f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-db5840de-960c-4851-b54e-73735523578f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:35:02.607878 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:35:02.609621 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:35:02.611235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 566/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:35:02.616050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c15be-f732-4911-a7e0-135ad9215a3f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:02.722495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c15be-f732-4911-a7e0-135ad9215a3f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:02.759478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:02.760173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:02.760455 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:02.760918 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:02.762126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:02.762443 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:02.763807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:02.772671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 591/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:02.778757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5840de-960c-4851-b54e-73735523578f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:02.849844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:02.882298 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5840de-960c-4851-b54e-73735523578f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:02.917986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:02.918626 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:02.918898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:02.919167 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] PATH_INFO: `/v3/users/8f4fc96993bc43e4b49ac71d195d1b71` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:02.920506 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] RBAC: Authorizing `identity:get_user(user_id=8f4fc96993bc43e4b49ac71d195d1b71)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:02.921986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:02.923586 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 567/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:35:02 2022] GET /identity/v3/users/8f4fc96993bc43e4b49ac71d195d1b71 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:02.929590 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:02.945702 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:03.042188 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970077eb-b8bd-4b30-8648-8f38071d8433 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:03.078375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:03.078982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:03.079260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:03.079531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:03.151026 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:03.152794 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:03.167707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:03.249107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 592/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:35:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:35:03.255548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:03.354150 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3b8fc-bfc0-4378-9817-0f82592f4f49 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:03.388168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423d163-a659-4c30-b584-dc79b867945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:03.388790 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423d163-a659-4c30-b584-dc79b867945e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:03.389071 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423d163-a659-4c30-b584-dc79b867945e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:03.389346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423d163-a659-4c30-b584-dc79b867945e None admin] PATH_INFO: `/v3/projects/230f83d1d8f04f5a9543809988ecf6a8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:03.390522 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423d163-a659-4c30-b584-dc79b867945e None admin] RBAC: Authorizing `identity:get_project(project_id=230f83d1d8f04f5a9543809988ecf6a8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:03.392690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423d163-a659-4c30-b584-dc79b867945e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:03.394458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 568/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:35:03 2022] GET /identity/v3/projects/230f83d1d8f04f5a9543809988ecf6a8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:03.401584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:03.504193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd3e15-2106-4de2-a57f-821401b456e0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:03.519764 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:03.539611 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64a8d-0ab6-408f-b36b-9147565bc927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:03.540215 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64a8d-0ab6-408f-b36b-9147565bc927 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:03.540495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64a8d-0ab6-408f-b36b-9147565bc927 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:03.540769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64a8d-0ab6-408f-b36b-9147565bc927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:03.541779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c64a8d-0ab6-408f-b36b-9147565bc927 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=230f83d1d8f04f5a9543809988ecf6a8, user.id=8f4fc96993bc43e4b49ac71d195d1b71) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:03.542089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c64a8d-0ab6-408f-b36b-9147565bc927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:03.543503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c64a8d-0ab6-408f-b36b-9147565bc927 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:03.549072 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 593/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:35:03 2022] GET /identity/v3/role_assignments?user.id=8f4fc96993bc43e4b49ac71d195d1b71&scope.project.id=230f83d1d8f04f5a9543809988ecf6a8&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:05.733938 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778233b-cf23-4984-bd58-6c4b0862c0eb None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:05.734526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778233b-cf23-4984-bd58-6c4b0862c0eb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:05.734526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778233b-cf23-4984-bd58-6c4b0862c0eb None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:05.735801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 569/1162] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:05.741233 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d1bf9-8aad-4552-b134-98ae6a67b447 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:05.741637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d1bf9-8aad-4552-b134-98ae6a67b447 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:05.741825 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d1bf9-8aad-4552-b134-98ae6a67b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:05.759541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-389d1bf9-8aad-4552-b134-98ae6a67b447 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:05.760725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-389d1bf9-8aad-4552-b134-98ae6a67b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:05.825994 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 594/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:35:06.096587 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778233b-cf23-4984-bd58-6c4b0862c0eb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:06.107914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:06.197930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778233b-cf23-4984-bd58-6c4b0862c0eb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:06.230827 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:06.231428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:06.231703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:06.231970 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:06.298178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:06.299616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:06.308918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:06.396785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 570/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:35:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:35:06.402634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d1bf9-8aad-4552-b134-98ae6a67b447 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:06.495655 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d1bf9-8aad-4552-b134-98ae6a67b447 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:06.504334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:06.528793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a3a4-715a-4aea-869c-532f0a7fa76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:06.529411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a3a4-715a-4aea-869c-532f0a7fa76d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:06.529723 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a3a4-715a-4aea-869c-532f0a7fa76d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:06.529997 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a3a4-715a-4aea-869c-532f0a7fa76d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:06.536354 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a3a4-715a-4aea-869c-532f0a7fa76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:06.537803 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a3a4-715a-4aea-869c-532f0a7fa76d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0e00a3a4-715a-4aea-869c-532f0a7fa76d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:35:06.548947 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:35:06.550167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:35:06.551025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 595/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:35:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:35:06.556544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:06.651447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e3c18-c774-477c-bf61-3571153ef9fc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:06.660264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:06.685247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f5721-509d-4d25-ab5c-876c79787e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:06.685882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5721-509d-4d25-ab5c-876c79787e0b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:06.686161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5721-509d-4d25-ab5c-876c79787e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:06.686432 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5721-509d-4d25-ab5c-876c79787e0b None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:06.687067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f5721-509d-4d25-ab5c-876c79787e0b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:06.687369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f5721-509d-4d25-ab5c-876c79787e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:06.688747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f5721-509d-4d25-ab5c-876c79787e0b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:06.696444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 571/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 22 02:35:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:08.828114 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580770-6b3b-4291-9c53-6cb0f4d73286 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:08.828669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580770-6b3b-4291-9c53-6cb0f4d73286 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:08.828669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580770-6b3b-4291-9c53-6cb0f4d73286 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:08.830036 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 596/1167] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:08.836081 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec1484-0294-4b80-ad8c-f8380c95cfa0 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:08.836503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec1484-0294-4b80-ad8c-f8380c95cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:08.836608 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec1484-0294-4b80-ad8c-f8380c95cfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:08.855668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8bec1484-0294-4b80-ad8c-f8380c95cfa0 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:08.856859 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8bec1484-0294-4b80-ad8c-f8380c95cfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:08.923790 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 572/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:35:09.197362 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580770-6b3b-4291-9c53-6cb0f4d73286 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:09.300880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580770-6b3b-4291-9c53-6cb0f4d73286 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:09.335967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab28eab-3689-49e1-822b-57afbb86fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:09.336570 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28eab-3689-49e1-822b-57afbb86fb1d None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:09.336847 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28eab-3689-49e1-822b-57afbb86fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:09.337117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28eab-3689-49e1-822b-57afbb86fb1d None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:09.337819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab28eab-3689-49e1-822b-57afbb86fb1d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:09.339177 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab28eab-3689-49e1-822b-57afbb86fb1d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:09.355762 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 597/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Thu Sep 22 02:35:09 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:35:11.555099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062e994-8f79-4e9c-bda0-130a16c9b70a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:11.555705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062e994-8f79-4e9c-bda0-130a16c9b70a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:11.555705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062e994-8f79-4e9c-bda0-130a16c9b70a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:11.556961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 573/1170] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:11.562155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067b0c9-66d5-4bb5-9e83-20cacdddd405 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:11.562592 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067b0c9-66d5-4bb5-9e83-20cacdddd405 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:11.562698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067b0c9-66d5-4bb5-9e83-20cacdddd405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:11.580627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d067b0c9-66d5-4bb5-9e83-20cacdddd405 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:11.581850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d067b0c9-66d5-4bb5-9e83-20cacdddd405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:11.604131 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:11.649202 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 598/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:35:11.922704 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062e994-8f79-4e9c-bda0-130a16c9b70a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:12.024417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062e994-8f79-4e9c-bda0-130a16c9b70a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:12.026024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:12.059709 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cc398-d76a-4c9f-9355-35e496b8609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:12.066156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc398-d76a-4c9f-9355-35e496b8609b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:12.066438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc398-d76a-4c9f-9355-35e496b8609b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:12.066711 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc398-d76a-4c9f-9355-35e496b8609b None admin] PATH_INFO: `/v3/domains/c63cbfd00f32498ba529e16758ecd568` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:12.078728 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cc398-d76a-4c9f-9355-35e496b8609b None admin] RBAC: Authorizing `identity:get_domain(domain_id=c63cbfd00f32498ba529e16758ecd568)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:12.080180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cc398-d76a-4c9f-9355-35e496b8609b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:12.081870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 574/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Sep 22 02:35:11 2022] GET /identity/v3/domains/c63cbfd00f32498ba529e16758ecd568 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:12.088352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067b0c9-66d5-4bb5-9e83-20cacdddd405 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:12.182776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067b0c9-66d5-4bb5-9e83-20cacdddd405 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:12.216165 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82e309-443e-401f-84c6-04226d940c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:12.216770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82e309-443e-401f-84c6-04226d940c77 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:12.217071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82e309-443e-401f-84c6-04226d940c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:12.217308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82e309-443e-401f-84c6-04226d940c77 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:12.218031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82e309-443e-401f-84c6-04226d940c77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:12.219389 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82e309-443e-401f-84c6-04226d940c77 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:12.245537 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 599/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:35:12 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:35:14.442579 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71084-953d-4593-b2a4-d6018f47b16a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:14.443141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71084-953d-4593-b2a4-d6018f47b16a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:14.443141 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71084-953d-4593-b2a4-d6018f47b16a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:14.444461 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 575/1174] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:14.449985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea06a-94c5-4fe4-8d9d-cf33c2cf2644 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:14.450421 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea06a-94c5-4fe4-8d9d-cf33c2cf2644 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:14.450520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea06a-94c5-4fe4-8d9d-cf33c2cf2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:14.468348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5a8ea06a-94c5-4fe4-8d9d-cf33c2cf2644 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:14.469528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5a8ea06a-94c5-4fe4-8d9d-cf33c2cf2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:14.472297 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:14.534667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 600/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:35:14.804488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71084-953d-4593-b2a4-d6018f47b16a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:14.905246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71084-953d-4593-b2a4-d6018f47b16a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:14.941681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09096a-b98f-4f49-a3fb-44ca2cce7524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:14.942351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09096a-b98f-4f49-a3fb-44ca2cce7524 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:14.943150 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09096a-b98f-4f49-a3fb-44ca2cce7524 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:14.943419 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09096a-b98f-4f49-a3fb-44ca2cce7524 None admin] PATH_INFO: `/v3/domains/c63cbfd00f32498ba529e16758ecd568` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:14.944612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09096a-b98f-4f49-a3fb-44ca2cce7524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c63cbfd00f32498ba529e16758ecd568)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:14.946110 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09096a-b98f-4f49-a3fb-44ca2cce7524 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:14.947747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 576/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Sep 22 02:35:14 2022] GET /identity/v3/domains/c63cbfd00f32498ba529e16758ecd568 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:14.953720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ea06a-94c5-4fe4-8d9d-cf33c2cf2644 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:15.058029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ea06a-94c5-4fe4-8d9d-cf33c2cf2644 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:15.092830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a4afb-912a-4dec-bd9a-80535c9e7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:15.093440 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a4afb-912a-4dec-bd9a-80535c9e7b11 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:15.093746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a4afb-912a-4dec-bd9a-80535c9e7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:15.094019 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a4afb-912a-4dec-bd9a-80535c9e7b11 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:15.094668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a4afb-912a-4dec-bd9a-80535c9e7b11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:15.096083 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a4afb-912a-4dec-bd9a-80535c9e7b11 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:15.108307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:15.122285 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 601/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:35:14 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:35:17.311598 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba4f4-e13c-4300-8f54-b3002004b419 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:17.312182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba4f4-e13c-4300-8f54-b3002004b419 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:17.312182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba4f4-e13c-4300-8f54-b3002004b419 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:17.313460 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 577/1178] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:17.319700 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4cbdd-9204-487a-a0da-1f5482ccead0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:17.320099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4cbdd-9204-487a-a0da-1f5482ccead0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:17.320245 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4cbdd-9204-487a-a0da-1f5482ccead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:17.338796 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a5f4cbdd-9204-487a-a0da-1f5482ccead0 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:17.339975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a5f4cbdd-9204-487a-a0da-1f5482ccead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:17.411316 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 602/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:35:17.680071 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeba4f4-e13c-4300-8f54-b3002004b419 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:17.711246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:17.784417 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeba4f4-e13c-4300-8f54-b3002004b419 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:17.819089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:17.819742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:17.820016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:17.820285 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:17.832997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:35:17.838048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:35:17.839312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:35:17.840409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 578/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:35:17.845565 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4cbdd-9204-487a-a0da-1f5482ccead0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:17.948549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4cbdd-9204-487a-a0da-1f5482ccead0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:17.974960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:17.984077 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:17.984688 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:17.984965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:17.985238 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:17.985927 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:17.986229 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:17.987574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:17.996174 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 603/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:18.002284 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:18.112462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:18.126503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8049-1f43-4239-8a29-35d183aef8fd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:18.162040 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:18.162660 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:18.162933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:18.163201 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] PATH_INFO: `/v3/users/ba1fcf19a0684414a846fde406501250` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:18.176434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] RBAC: Authorizing `identity:get_user(user_id=ba1fcf19a0684414a846fde406501250)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:18.178474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:18.180104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 579/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:35:18 2022] GET /identity/v3/users/ba1fcf19a0684414a846fde406501250 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:18.185935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:18.281875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4352425-825b-404e-a234-3dd2bbd63437 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:18.319041 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:18.319644 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:18.319923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:18.320457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:18.374973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:18.387807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:18.389250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:18.485964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 604/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:35:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:35:18.491918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:18.590048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8f4e-e85b-4848-97c5-9238b93f9756 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:18.624895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a492c1-0004-4a85-ae35-fc1d659ab778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:18.625521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a492c1-0004-4a85-ae35-fc1d659ab778 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:18.625829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a492c1-0004-4a85-ae35-fc1d659ab778 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:18.626098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a492c1-0004-4a85-ae35-fc1d659ab778 None admin] PATH_INFO: `/v3/projects/d1e3b3ac787f4099b41462861bd390a6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:18.627200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a492c1-0004-4a85-ae35-fc1d659ab778 None admin] RBAC: Authorizing `identity:get_project(project_id=d1e3b3ac787f4099b41462861bd390a6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:18.628615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a492c1-0004-4a85-ae35-fc1d659ab778 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:18.630434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 580/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:35:18 2022] GET /identity/v3/projects/d1e3b3ac787f4099b41462861bd390a6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:18.636902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:18.721640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:18.735256 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37fb7f-ce4b-4433-b38f-397d59544999 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:18.770093 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ba718-bfa6-4343-acce-55182941fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:18.771275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba718-bfa6-4343-acce-55182941fcef None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:18.771555 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba718-bfa6-4343-acce-55182941fcef None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:18.771828 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba718-bfa6-4343-acce-55182941fcef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:18.772550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba718-bfa6-4343-acce-55182941fcef None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=d1e3b3ac787f4099b41462861bd390a6, user.id=ba1fcf19a0684414a846fde406501250) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:18.772860 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba718-bfa6-4343-acce-55182941fcef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:18.774293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba718-bfa6-4343-acce-55182941fcef None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:18.779454 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 605/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:35:18 2022] GET /identity/v3/role_assignments?user.id=ba1fcf19a0684414a846fde406501250&scope.project.id=d1e3b3ac787f4099b41462861bd390a6&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:20.905251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618619-2407-4ab1-b692-4ae727249a63 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:20.905801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618619-2407-4ab1-b692-4ae727249a63 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:20.905912 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618619-2407-4ab1-b692-4ae727249a63 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:20.907216 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 581/1186] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:20.916322 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256d276-9b8e-4e9d-af17-9d9ec0d1f9f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:20.917050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256d276-9b8e-4e9d-af17-9d9ec0d1f9f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:20.917154 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256d276-9b8e-4e9d-af17-9d9ec0d1f9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:20.939707 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2256d276-9b8e-4e9d-af17-9d9ec0d1f9f9 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:20.940904 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2256d276-9b8e-4e9d-af17-9d9ec0d1f9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:21.005522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 606/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:35:21.279737 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618619-2407-4ab1-b692-4ae727249a63 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:21.298131 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:21.380082 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618619-2407-4ab1-b692-4ae727249a63 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:21.413217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:21.413862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:21.414137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:21.414404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:21.424404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:35:21.429215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:35:21.430389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:35:21.431395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 582/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:35:21.436599 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256d276-9b8e-4e9d-af17-9d9ec0d1f9f9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:21.514733 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:21.532774 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256d276-9b8e-4e9d-af17-9d9ec0d1f9f9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:21.565493 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:21.566117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:21.566397 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:21.566668 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:21.567892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:21.568196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:21.569545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:21.577617 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 607/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:21.583602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:21.660574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:21.683310 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781020b-358e-4e07-b74f-9612647313d6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:21.715804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:21.716416 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:21.716690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:21.716960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] PATH_INFO: `/v3/users/ba1fcf19a0684414a846fde406501250` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:21.718079 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] RBAC: Authorizing `identity:get_user(user_id=ba1fcf19a0684414a846fde406501250)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:21.719485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:21.721022 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 583/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:35:21 2022] GET /identity/v3/users/ba1fcf19a0684414a846fde406501250 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:21.727027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:21.824985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83abd-d4ee-4b31-b2de-3ef8d4916bc8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:21.856948 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c882ff6-b7f5-443a-934a-553db589ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:21.857572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c882ff6-b7f5-443a-934a-553db589ae9d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:21.857879 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c882ff6-b7f5-443a-934a-553db589ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:21.858156 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c882ff6-b7f5-443a-934a-553db589ae9d None admin] PATH_INFO: `/v3/projects/d1e3b3ac787f4099b41462861bd390a6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:21.859264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c882ff6-b7f5-443a-934a-553db589ae9d None admin] RBAC: Authorizing `identity:get_project(project_id=d1e3b3ac787f4099b41462861bd390a6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:21.860685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c882ff6-b7f5-443a-934a-553db589ae9d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:21.862351 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 608/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:35:21 2022] GET /identity/v3/projects/d1e3b3ac787f4099b41462861bd390a6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:21.868456 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:21.964431 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7b47a-d172-463a-b85c-677cb82f26d4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:21.997305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c88c51-21fc-4d31-acaf-c94f61dd261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:21.997978 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88c51-21fc-4d31-acaf-c94f61dd261e None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:21.998256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88c51-21fc-4d31-acaf-c94f61dd261e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:21.998526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88c51-21fc-4d31-acaf-c94f61dd261e None admin] PATH_INFO: `/v3/projects/d1e3b3ac787f4099b41462861bd390a6/users/ba1fcf19a0684414a846fde406501250/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:22.000399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c88c51-21fc-4d31-acaf-c94f61dd261e None admin] RBAC: Authorizing `identity:create_grant(project_id=d1e3b3ac787f4099b41462861bd390a6, user_id=ba1fcf19a0684414a846fde406501250, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:22.001849 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c88c51-21fc-4d31-acaf-c94f61dd261e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:22.014821 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 584/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:35:21 2022] PUT /identity/v3/projects/d1e3b3ac787f4099b41462861bd390a6/users/ba1fcf19a0684414a846fde406501250/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:35:24.157264 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f564f6c-46bb-4d39-8e55-5da5fc93cc2b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:24.157865 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f564f6c-46bb-4d39-8e55-5da5fc93cc2b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:24.157865 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f564f6c-46bb-4d39-8e55-5da5fc93cc2b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:24.159187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 609/1193] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:35:24.165137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760fe0-85b9-4e08-a293-7ff20dc714bc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:24.165540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760fe0-85b9-4e08-a293-7ff20dc714bc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:24.165672 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760fe0-85b9-4e08-a293-7ff20dc714bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:24.173103 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:24.185867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-5a760fe0-85b9-4e08-a293-7ff20dc714bc None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:35:24.187060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5a760fe0-85b9-4e08-a293-7ff20dc714bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:35:24.251995 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 585/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:35:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:35:24.524040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f564f6c-46bb-4d39-8e55-5da5fc93cc2b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:24.538904 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:24.624407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f564f6c-46bb-4d39-8e55-5da5fc93cc2b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:24.658521 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:24.659476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:24.659908 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:24.660326 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:24.671239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:35:24.676050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:35:24.677680 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:35:24.678544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 610/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:35:24.683776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760fe0-85b9-4e08-a293-7ff20dc714bc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:24.780733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760fe0-85b9-4e08-a293-7ff20dc714bc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:24.815215 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:24.815817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:24.816090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:24.816355 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:24.817004 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:24.817345 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:24.818733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:24.820050 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:24.827512 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 586/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:24.833897 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:24.901920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:24.931460 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5a5e-8874-40b7-8bfb-6f9870fedfe0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:24.963542 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:24.964169 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:24.964453 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:24.964729 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] PATH_INFO: `/v3/users/ba1fcf19a0684414a846fde406501250` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:24.965877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] RBAC: Authorizing `identity:get_user(user_id=ba1fcf19a0684414a846fde406501250)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:24.967295 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:24.968894 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 611/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 22 02:35:24 2022] GET /identity/v3/users/ba1fcf19a0684414a846fde406501250 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:24.975472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:25.074432 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ee9a-113f-4026-bb1a-dffe4c1a97ca None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:25.110024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:25.110746 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:25.111024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:25.111299 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:25.171810 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:25.183198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:25.186093 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:25.283259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 587/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:35:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:35:25.289193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:25.386067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a6675-001e-47a9-b2c3-b9b495717155 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:25.417718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3bd7-9228-4927-a00c-faafbe8d3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:25.418340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3bd7-9228-4927-a00c-faafbe8d3667 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:25.418618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3bd7-9228-4927-a00c-faafbe8d3667 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:25.418887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3bd7-9228-4927-a00c-faafbe8d3667 None admin] PATH_INFO: `/v3/projects/d1e3b3ac787f4099b41462861bd390a6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:25.420004 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3bd7-9228-4927-a00c-faafbe8d3667 None admin] RBAC: Authorizing `identity:get_project(project_id=d1e3b3ac787f4099b41462861bd390a6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:25.421416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3bd7-9228-4927-a00c-faafbe8d3667 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:25.423066 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 612/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 22 02:35:25 2022] GET /identity/v3/projects/d1e3b3ac787f4099b41462861bd390a6 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:25.429879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:35:25.526010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:25.531845 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328cb9-f341-4945-b9d4-764fcce91672 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:35:25.565371 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007a570-4e74-45f1-8a78-f6660e82ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:35:25.566007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a570-4e74-45f1-8a78-f6660e82ce03 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:35:25.566294 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a570-4e74-45f1-8a78-f6660e82ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:35:25.566569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a570-4e74-45f1-8a78-f6660e82ce03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:35:25.567795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007a570-4e74-45f1-8a78-f6660e82ce03 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=d1e3b3ac787f4099b41462861bd390a6, user.id=ba1fcf19a0684414a846fde406501250) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:35:25.568101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007a570-4e74-45f1-8a78-f6660e82ce03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:35:25.569532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007a570-4e74-45f1-8a78-f6660e82ce03 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:35:25.575389 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 588/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:35:25 2022] GET /identity/v3/role_assignments?user.id=ba1fcf19a0684414a846fde406501250&scope.project.id=d1e3b3ac787f4099b41462861bd390a6&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:35:35.413953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:35:35.573205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=20 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:23.335739 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd61b-bfad-4429-825a-33277a38c4ca None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:23.336730 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd61b-bfad-4429-825a-33277a38c4ca None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:23.336730 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd61b-bfad-4429-825a-33277a38c4ca None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:23.339401 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 613/1201] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:36:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:36:23.347815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294f02-761e-449d-9c58-c571b81cdeca None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:23.348402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294f02-761e-449d-9c58-c571b81cdeca None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:23.348692 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294f02-761e-449d-9c58-c571b81cdeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:23.381495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-92294f02-761e-449d-9c58-c571b81cdeca None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:36:23.384152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-92294f02-761e-449d-9c58-c571b81cdeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:36:23.531569 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 589/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:36:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:36:23.824600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd61b-bfad-4429-825a-33277a38c4ca None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:23.995784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd61b-bfad-4429-825a-33277a38c4ca None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:24.076567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:24.077283 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:24.077600 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:24.077938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:24.101675 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:24.103991 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:24.123701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:24.126059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:24.127983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:24.127983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:24.127983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:24.127983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 614/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:24.139534 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294f02-761e-449d-9c58-c571b81cdeca None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:24.322509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294f02-761e-449d-9c58-c571b81cdeca None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:24.381368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:24.395902 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cd661-8fc9-4842-836c-3afa9d9667ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:24.397224 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cd661-8fc9-4842-836c-3afa9d9667ed None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:24.397738 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cd661-8fc9-4842-836c-3afa9d9667ed None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:24.398509 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cd661-8fc9-4842-836c-3afa9d9667ed None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:24.399782 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cd661-8fc9-4842-836c-3afa9d9667ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:24.400343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cd661-8fc9-4842-836c-3afa9d9667ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:24.402924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cd661-8fc9-4842-836c-3afa9d9667ed None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:24.432434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 590/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:36:24.443690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:24.564304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:24.667471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7ea25-f25b-4407-8b9d-a14891d2769e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:24.737907 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03cadf-b7a1-490f-8d51-75e26bd1baa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:24.739437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03cadf-b7a1-490f-8d51-75e26bd1baa4 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:24.740198 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03cadf-b7a1-490f-8d51-75e26bd1baa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:24.740748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03cadf-b7a1-490f-8d51-75e26bd1baa4 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:24.742106 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03cadf-b7a1-490f-8d51-75e26bd1baa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:24.744880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03cadf-b7a1-490f-8d51-75e26bd1baa4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:24.793706 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 615/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 22 02:36:24 2022] POST /identity/v3/users => generated 251 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 02:36:27.703604 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05addd1e-4b36-4abe-99bd-6c1536e10434 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:27.704334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05addd1e-4b36-4abe-99bd-6c1536e10434 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:27.704436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05addd1e-4b36-4abe-99bd-6c1536e10434 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:27.705959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 591/1206] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:36:27.715465 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceac95a-43af-42a1-a49f-3cf7aa9d53e3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:27.716185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceac95a-43af-42a1-a49f-3cf7aa9d53e3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:27.716185 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceac95a-43af-42a1-a49f-3cf7aa9d53e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:27.744438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-aceac95a-43af-42a1-a49f-3cf7aa9d53e3 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:36:27.747821 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-aceac95a-43af-42a1-a49f-3cf7aa9d53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:36:27.872164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 616/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:36:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:36:28.201023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05addd1e-4b36-4abe-99bd-6c1536e10434 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:28.386720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05addd1e-4b36-4abe-99bd-6c1536e10434 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:28.441996 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:28.442668 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:28.442905 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:28.443115 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:28.463069 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:36:28.469837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:28.471722 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:36:28.473929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:28.478077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 592/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:28.481341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceac95a-43af-42a1-a49f-3cf7aa9d53e3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:28.531953 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:28.626348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceac95a-43af-42a1-a49f-3cf7aa9d53e3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:28.685477 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:28.686491 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:28.687016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:28.687336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:28.688106 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:28.688403 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:28.689906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:28.700443 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 617/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:28.714120 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:28.802957 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:28.885047 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c710d-0745-4050-888d-a9ab07810ab3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:28.960335 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:28.961450 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:28.962000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:28.962909 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:28.979563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:28.981329 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:29.000653 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:29.002199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:29.012313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:29.012313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:29.012313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:29.012313 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 593/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:29.012544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:29.192302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:29.196584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0346312-50c7-48c9-ab52-3bb71637dc5e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:29.265967 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:29.266923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:29.267407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:29.267895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:29.268997 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:29.270208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:29.273199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:29.299893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 618/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:36:29.306841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:29.480247 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e115e-6a5d-4be3-8b46-f539c2b8dd65 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:29.483173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:29.547977 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:29.548778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:29.549176 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:29.549679 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:29.565681 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:29.568023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:36:29.593089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:29.595268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:29.597771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 594/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:29.604274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:29.786174 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd5f7-c5c4-4797-ba69-e299c7f7fced None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:29.864134 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:29.865297 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:29.865858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:29.866407 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:29.868017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:29.868614 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:29.871658 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:29.909140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 619/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 22 02:36:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:29.919662 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:30.127236 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2eaeb-d69d-4351-92f2-ad14de28729b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:30.192834 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:30.193597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:30.194034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:30.194351 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:30.258728 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:30.334622 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:30.336436 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:30.490152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 595/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:36:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:36:30.496951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:30.522673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:30.668030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621ce48-60e1-4f85-8929-a115b7a6d6e0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:30.715839 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:30.716550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:30.716858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:30.717171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:30.733623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:30.733623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:30.765736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:30.767140 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:30.768422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:30.768422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:30.768422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:30.768422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 620/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:30.775378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:30.880248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:30.943201 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16010c73-4c5f-4637-9b26-b61f3e9bea08 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:30.985012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:30.986003 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:30.986277 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:30.986549 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:30.987227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:30.987607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:30.989820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:31.004885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 596/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:36:31.011385 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:31.119625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:31.172777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3753f-ca04-49cf-a8e4-453697372359 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:31.223920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:31.224970 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:31.225492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:31.225975 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:31.236474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:31.239041 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:36:31.255720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:31.257735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:31.258731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 621/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:36:31.267214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:31.421639 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b94492-44fd-43b7-9dc7-db19fff94d68 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:31.449091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:31.469171 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df4fcc-6f23-4d89-b0da-f9b07db28a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:31.470104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4fcc-6f23-4d89-b0da-f9b07db28a77 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:31.470488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4fcc-6f23-4d89-b0da-f9b07db28a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:31.471040 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4fcc-6f23-4d89-b0da-f9b07db28a77 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:31.472650 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df4fcc-6f23-4d89-b0da-f9b07db28a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:31.473134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df4fcc-6f23-4d89-b0da-f9b07db28a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:31.475137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df4fcc-6f23-4d89-b0da-f9b07db28a77 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:31.490134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 597/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:31.497302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:31.641343 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca782a8-69d7-4a0a-a366-475b20c7be01 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:31.692895 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:31.704781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417ffd-6d6e-48a7-8afa-73c7f3cee5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:31.705824 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417ffd-6d6e-48a7-8afa-73c7f3cee5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:31.706320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417ffd-6d6e-48a7-8afa-73c7f3cee5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:31.707367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417ffd-6d6e-48a7-8afa-73c7f3cee5c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:31.708810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417ffd-6d6e-48a7-8afa-73c7f3cee5c2 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=a8711bb78a6e4077aad9f5491c38173b) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:31.709346 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417ffd-6d6e-48a7-8afa-73c7f3cee5c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:31.711462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417ffd-6d6e-48a7-8afa-73c7f3cee5c2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:31.720502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 622/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:36:31 2022] GET /identity/v3/role_assignments?user.id=a8711bb78a6e4077aad9f5491c38173b&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:34.127953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506275-68f2-4d7a-bcf3-44484f1765ee None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:34.129263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506275-68f2-4d7a-bcf3-44484f1765ee None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:34.129592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506275-68f2-4d7a-bcf3-44484f1765ee None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:34.133117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 598/1220] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:36:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:36:34.142660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fedcd1-46e9-4e84-9869-2070772a058d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:34.143182 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fedcd1-46e9-4e84-9869-2070772a058d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:34.143182 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fedcd1-46e9-4e84-9869-2070772a058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:34.168462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-72fedcd1-46e9-4e84-9869-2070772a058d None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:36:34.170003 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-72fedcd1-46e9-4e84-9869-2070772a058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:36:34.275133 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 623/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:36:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:36:34.556103 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c506275-68f2-4d7a-bcf3-44484f1765ee None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:34.687816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c506275-68f2-4d7a-bcf3-44484f1765ee None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:34.749909 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:34.750581 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:34.750832 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:34.751104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:34.762980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:36:34.771635 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:34.773815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:34.775853 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 599/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:34.782682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fedcd1-46e9-4e84-9869-2070772a058d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:34.932481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fedcd1-46e9-4e84-9869-2070772a058d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:34.972777 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:34.984682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:34.985307 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:34.985585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:34.989419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:34.989419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:34.989419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:34.989419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:34.997981 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 624/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:35.004557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:35.067758 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:35.143663 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49afd32-7369-4ab3-923d-e56f09877598 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:35.190686 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:35.191318 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:35.191592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:35.191862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:35.203910 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:35.205859 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:35.224900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:35.226674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:35.228217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:35.228217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:35.228217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:35.228217 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 600/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:35.232589 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:35.366805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627a293-4029-4612-827b-4d03d5156bf8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:35.408693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:35.409543 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:35.410060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:35.410453 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:35.411366 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:35.411784 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:35.413412 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:35.434909 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 625/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:35.445043 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:35.577908 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:35.591000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bffc8c-128b-4eef-a96c-9efbe855ffe8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:35.639796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:35.640765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:35.641184 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:35.641646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:35.656008 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:35.658508 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:36:35.682279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:35.683505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:35.684539 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 601/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:35.694148 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:35.767492 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:35.837341 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103196f8-ff48-4b8b-a522-25b781eebfb2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:35.880267 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:35.881280 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:35.881627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:35.881960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:35.882886 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:35.883196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:35.884814 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:35.910502 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 626/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 22 02:36:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:35.917441 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:36.068388 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cbd58-fff1-43c0-a522-3c07b2277edb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:36.109907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819099-778d-4d37-9238-4d07523e089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:36.110552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819099-778d-4d37-9238-4d07523e089a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:36.110830 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819099-778d-4d37-9238-4d07523e089a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:36.111096 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819099-778d-4d37-9238-4d07523e089a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:36.125616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94819099-778d-4d37-9238-4d07523e089a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:36.128929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94819099-778d-4d37-9238-4d07523e089a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-94819099-778d-4d37-9238-4d07523e089a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:36.152399 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:36.154894 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:36.156125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:36.156125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:36.156125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:36.156125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 602/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:36.162376 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:36.300584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7de9ae-7fc4-461f-b152-de7d5a13c497 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:36.304454 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:36.349347 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:36.350367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:36.350880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:36.351437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:36.352590 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:36.353114 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:36.355581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:36.376876 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 627/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:36:36.384832 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819099-778d-4d37-9238-4d07523e089a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:36.400046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:36.517554 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819099-778d-4d37-9238-4d07523e089a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:36.591690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:36.592336 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:36.592614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:36.592885 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:36.600766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:36.602394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:36:36.615102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:36.617295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:36.619145 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 603/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:36.625051 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:36.765572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56e2a-5260-4394-9850-29c2e6d8920f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:36.813246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fb586-a53d-4290-b421-3fbccdb604f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:36.813958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb586-a53d-4290-b421-3fbccdb604f8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:36.814290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb586-a53d-4290-b421-3fbccdb604f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:36.814578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb586-a53d-4290-b421-3fbccdb604f8 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:36.815254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb586-a53d-4290-b421-3fbccdb604f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:36.815561 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb586-a53d-4290-b421-3fbccdb604f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:36.817155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb586-a53d-4290-b421-3fbccdb604f8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:36.832869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 628/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:36.840114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:36.986376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:37.038448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4397913-980d-4399-954a-a0874d8234ed None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:37.091901 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffcac-8ade-4ccb-9268-1facfe4086b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:37.093047 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffcac-8ade-4ccb-9268-1facfe4086b2 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:37.093333 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffcac-8ade-4ccb-9268-1facfe4086b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:37.093600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffcac-8ade-4ccb-9268-1facfe4086b2 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/a8711bb78a6e4077aad9f5491c38173b/roles/04e96ff01f0a484ba43803759e6eabe9` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:37.115090 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffcac-8ade-4ccb-9268-1facfe4086b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=a8711bb78a6e4077aad9f5491c38173b, role_id=04e96ff01f0a484ba43803759e6eabe9)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:37.116633 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffcac-8ade-4ccb-9268-1facfe4086b2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:37.135687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 604/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:36:36 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/a8711bb78a6e4077aad9f5491c38173b/roles/04e96ff01f0a484ba43803759e6eabe9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:36:39.587315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4a0b-45f2-4203-9157-2c56797f7d74 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:39.587913 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4a0b-45f2-4203-9157-2c56797f7d74 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:39.588162 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4a0b-45f2-4203-9157-2c56797f7d74 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:39.593694 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 629/1233] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:36:39.595796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a695-ebe1-47ee-80c5-f87714df8e82 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:39.596246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a695-ebe1-47ee-80c5-f87714df8e82 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:39.596387 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a695-ebe1-47ee-80c5-f87714df8e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:39.616337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d236a695-ebe1-47ee-80c5-f87714df8e82 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:36:39.618648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d236a695-ebe1-47ee-80c5-f87714df8e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:36:39.726137 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 605/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:36:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:36:39.994789 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4a0b-45f2-4203-9157-2c56797f7d74 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:40.027216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:40.122254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4a0b-45f2-4203-9157-2c56797f7d74 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:40.164818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:40.165504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:40.165950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:40.166293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:40.180367 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:36:40.186411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:40.187615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:40.188481 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 630/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 22 02:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:40.197074 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a695-ebe1-47ee-80c5-f87714df8e82 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:40.261334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:40.337118 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a695-ebe1-47ee-80c5-f87714df8e82 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:40.380176 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:40.380725 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:40.380998 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:40.381263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:40.382243 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:40.382547 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:40.384049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:40.393033 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 606/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 22 02:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:40.400487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:40.498840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:40.521510 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442740aa-916e-4bbe-b698-18d604107082 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:40.576064 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:40.577153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:40.577687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:40.578220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:40.591974 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:40.593561 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:40.609071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:40.610292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:40.616352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:40.616352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:40.616352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:40.616352 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 631/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:36:40.616809 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:40.766438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108753-0572-4e30-a357-edcab24805f0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:40.778951 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:40.807497 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:40.808220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:40.808500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:40.808797 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:40.809479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:40.809879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:40.811507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:40.825492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 607/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:40.832717 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:40.962679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1981d-73b3-4f21-90db-1a111fb4c47b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:41.011398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:41.017771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:41.017771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:41.017771 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:41.018399 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:41.027160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:41.029880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:36:41.045708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:41.047425 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:41.049604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 632/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:41.055044 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:41.180447 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df5f66-3a0a-484c-8e7a-d0e0ad5efba5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:41.228233 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:41.228910 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:41.229251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:41.229637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:41.230935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:41.231449 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:41.234074 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:41.260278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 608/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 22 02:36:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:41.267017 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:41.401191 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecf1c2-f0ec-4ef2-af45-329a588ecbb7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:41.446575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:41.447623 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:41.448118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:41.448552 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:41.530831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:41.539701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:41.541729 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:41.686589 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 633/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:36:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:36:41.694820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:41.738847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:41.856139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ade47-6956-4e59-b431-1a3fa4990a8a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:41.902170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:41.902873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:41.903109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:41.903395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:41.915603 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:41.917230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:41.935314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:41.936577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:41.937721 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:41.937721 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:41.937721 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:41.937721 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 609/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:41.943635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:42.083620 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:42.092192 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf5217-f056-4665-9239-ec702268c9a9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:42.142303 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:42.143033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:42.143499 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:42.143918 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:42.144865 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:42.145303 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:42.147231 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:42.163957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 634/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:36:42.171165 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:42.274850 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:42.309453 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b95c1b-1101-4333-91de-c1bd01609152 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:42.361002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:42.362344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:42.362669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:42.362966 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:42.374448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:42.376345 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:36:42.391073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:42.392630 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:42.394555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 610/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:42.398999 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:42.541332 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabeb4c-eba8-46e1-a3ea-3b5a6bee31a2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:42.594693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fb894-b67b-44dc-b51b-d01cdfc0a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:42.595375 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fb894-b67b-44dc-b51b-d01cdfc0a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:42.595690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fb894-b67b-44dc-b51b-d01cdfc0a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:42.595977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fb894-b67b-44dc-b51b-d01cdfc0a2c5 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:42.596866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fb894-b67b-44dc-b51b-d01cdfc0a2c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:42.597931 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fb894-b67b-44dc-b51b-d01cdfc0a2c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:42.599557 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fb894-b67b-44dc-b51b-d01cdfc0a2c5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:42.616454 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 635/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:42.624324 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:42.763613 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b16b2-1bc7-444d-a465-bee3ca5d28ae None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:42.815148 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede62cf4-e1b4-484c-94d3-16bbff576d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:42.816214 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede62cf4-e1b4-484c-94d3-16bbff576d99 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:42.816560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede62cf4-e1b4-484c-94d3-16bbff576d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:42.816896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede62cf4-e1b4-484c-94d3-16bbff576d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:42.817737 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede62cf4-e1b4-484c-94d3-16bbff576d99 None admin] RBAC: Adding query filter params (role.id=04e96ff01f0a484ba43803759e6eabe9, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=a8711bb78a6e4077aad9f5491c38173b) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:42.818131 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede62cf4-e1b4-484c-94d3-16bbff576d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:42.819571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede62cf4-e1b4-484c-94d3-16bbff576d99 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:42.826369 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 611/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:36:42 2022] GET /identity/v3/role_assignments?user.id=a8711bb78a6e4077aad9f5491c38173b&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=04e96ff01f0a484ba43803759e6eabe9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:45.254528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717c6e-306a-407b-93de-828b236d3267 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:45.255137 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717c6e-306a-407b-93de-828b236d3267 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:45.255137 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717c6e-306a-407b-93de-828b236d3267 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:45.257938 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 636/1247] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:36:45.262596 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af564-20b9-4c4e-91f1-a03f4bc840fa None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:45.263132 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af564-20b9-4c4e-91f1-a03f4bc840fa None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:45.263354 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af564-20b9-4c4e-91f1-a03f4bc840fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:45.273883 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:45.292420 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-991af564-20b9-4c4e-91f1-a03f4bc840fa None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:36:45.294507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-991af564-20b9-4c4e-91f1-a03f4bc840fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:36:45.388990 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 612/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:36:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:36:45.670852 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26717c6e-306a-407b-93de-828b236d3267 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:45.691627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:45.803466 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26717c6e-306a-407b-93de-828b236d3267 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:45.853111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:45.854240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:45.854731 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:45.855234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:45.872234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:36:45.877631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:45.878769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:45.879802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 637/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:36:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:45.885449 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af564-20b9-4c4e-91f1-a03f4bc840fa None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:46.021045 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af564-20b9-4c4e-91f1-a03f4bc840fa None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:46.072702 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:46.082273 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:46.083548 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:46.084160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:46.084700 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:46.085940 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:46.086491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:46.088745 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:46.102061 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 613/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:36:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:46.110550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:46.209097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:46.239650 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b5e4-7bb1-4e55-8517-6dc0a41972d0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:46.283543 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:46.285044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:46.285044 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:46.285265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:46.299365 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:46.301670 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:46.321687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:46.323320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:46.324648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:46.324648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:46.324648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:46.324648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 638/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:46.332986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:46.469085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509fdf7-2f8f-4edf-a84d-64b3da496c69 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:46.515777 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:46.516796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:46.517264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:46.517895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:46.519470 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:46.519980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:46.521845 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:46.540496 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 614/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:46.550199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:46.704006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8907b6-84f9-4b9d-807e-c95bb9f82971 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:46.744624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:46.755592 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:46.756290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:46.756683 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:46.756929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:46.766182 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:46.767985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:36:46.782340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:46.784033 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:46.785302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 639/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:46.790556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:46.869498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:46.930505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a01db2-28bc-4b26-bd56-b89278ccf43c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:46.977415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:46.978331 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:46.978716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:46.979161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:46.980350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:46.980862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:46.983006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:47.016051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 615/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 22 02:36:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 02:36:47.022797 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:47.169626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8d91-2a2c-45b7-9a33-ac0f62972f55 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:47.220779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:47.221438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:47.221887 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:47.222187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:47.288831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:47.303281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:47.304758 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:47.433962 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 640/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:36:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 02:36:47.440818 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:47.585915 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868bef0-450e-40b0-96e9-c62e5c399312 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:47.602969 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:47.641871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:47.642510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:47.642777 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:47.643051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:47.661178 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:47.662678 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:47.688200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:47.689421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:47.691032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:47.691032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:47.691032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:47.691032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 616/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:36:47.696342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:47.833289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:47.850240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4723-6969-4550-969e-ec7fb63199fd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:47.893371 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:47.894581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:47.894855 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:47.895128 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:47.895792 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:47.896087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:47.897476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:47.914060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 641/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:47.921188 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:48.068585 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c8a7f-0771-4986-b59c-85313825c30f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:48.111280 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:48.111847 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:48.112191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:48.113191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:48.125523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:48.127594 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:36:48.143555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:48.145264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:48.146259 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 617/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:48.154462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:48.308037 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3703d-ec66-4fdd-8af5-8adc6ac8e01f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:48.349445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a0a5d-a19c-45fe-96dc-dc9ce97b8d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:48.350125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0a5d-a19c-45fe-96dc-dc9ce97b8d2b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:48.350404 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0a5d-a19c-45fe-96dc-dc9ce97b8d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:48.350708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0a5d-a19c-45fe-96dc-dc9ce97b8d2b None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:48.351438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a0a5d-a19c-45fe-96dc-dc9ce97b8d2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:48.351786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a0a5d-a19c-45fe-96dc-dc9ce97b8d2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:48.353321 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a0a5d-a19c-45fe-96dc-dc9ce97b8d2b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:48.366768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 642/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:48.372796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:48.405784 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:48.504767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6e864-ddf7-4fa8-be4e-c8592d313fd5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:48.553308 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49502238-31c1-472a-92db-eda4ae549cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:48.553979 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49502238-31c1-472a-92db-eda4ae549cfb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:48.554257 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49502238-31c1-472a-92db-eda4ae549cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:48.554558 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49502238-31c1-472a-92db-eda4ae549cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:48.555384 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49502238-31c1-472a-92db-eda4ae549cfb None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=a8711bb78a6e4077aad9f5491c38173b) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:48.555691 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49502238-31c1-472a-92db-eda4ae549cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:48.557199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49502238-31c1-472a-92db-eda4ae549cfb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:48.566501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 618/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:36:48 2022] GET /identity/v3/role_assignments?user.id=a8711bb78a6e4077aad9f5491c38173b&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:50.860370 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfc35c-b95b-4b45-b941-587bdc4addfc None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:50.860902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfc35c-b95b-4b45-b941-587bdc4addfc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:50.860902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfc35c-b95b-4b45-b941-587bdc4addfc None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:50.862272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 643/1261] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:36:50.868248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f0f9b-207f-4580-960a-78e0056ebe02 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:50.868752 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f0f9b-207f-4580-960a-78e0056ebe02 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:50.868851 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f0f9b-207f-4580-960a-78e0056ebe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:50.889343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e79f0f9b-207f-4580-960a-78e0056ebe02 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:36:50.890767 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e79f0f9b-207f-4580-960a-78e0056ebe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:36:50.969128 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 619/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:36:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:36:51.263627 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfc35c-b95b-4b45-b941-587bdc4addfc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:51.275128 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:51.400130 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfc35c-b95b-4b45-b941-587bdc4addfc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:51.441234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:51.442060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:51.442348 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:51.442853 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:51.455917 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:36:51.461293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:51.462950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:51.463859 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 644/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:36:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:51.468834 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f0f9b-207f-4580-960a-78e0056ebe02 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:51.488203 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:51.576434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f0f9b-207f-4580-960a-78e0056ebe02 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:51.615643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:51.616248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:51.616523 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:51.616791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:51.617457 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:51.617791 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:51.619168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:51.628160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 620/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:51.634159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:51.715862 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:51.766148 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2ea86-623c-45cd-ae4a-e0d9a1ebca13 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:51.804977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:51.805608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:51.805905 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:51.806171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:51.819899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:51.821430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:51.837701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:51.839006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:51.841029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:51.841029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:51.841029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:51.841029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 645/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:51.844650 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:51.930495 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:51.951648 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e6315-9614-41ba-af7b-d3777656b653 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:51.988568 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:51.989182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:51.989458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:51.989754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:51.990394 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:51.990692 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:51.992058 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:52.005856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 621/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:52.013016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:52.125155 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e285-9483-4455-a9ab-dadea151a617 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:52.150759 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:52.170818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:52.171416 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:52.171750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:52.172075 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:52.180940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:52.182405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:36:52.195447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:52.196667 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:52.197877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 646/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:52.202571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:52.315800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336e0c-4764-4e08-b236-33cbd1cf024e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:52.353931 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:52.354552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:52.354831 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:52.355100 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:52.355837 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:52.356139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:52.357589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:52.368766 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:52.379300 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 622/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 22 02:36:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:52.385368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:52.498742 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd213-6ba1-48a1-9c87-7a9ac0777dca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:52.540270 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:52.541183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:52.541542 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:52.541928 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:52.556679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:52.558390 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:52.576898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:52.578274 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:52.579447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:52.579447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:52.579447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:52.579447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 647/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:52.585412 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:52.707254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201fa4-017d-4798-b9bf-4a1921dfcb20 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:52.746175 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:52.746780 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:52.747055 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:52.747325 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:52.747968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:52.748269 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:52.749633 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:52.761480 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 623/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:52.769807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:52.803128 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:52.885728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae57b0-67fc-4f7e-8ffb-4743815a4167 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:52.930568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:52.931203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:52.931476 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:52.931745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:52.938746 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:52.940190 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:36:52.952501 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:52.953698 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:52.954610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 648/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:52.959717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:53.020775 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:53.064890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067f30-4443-4fc0-b652-b6f67bb1177b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:53.098666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3c922-dcfd-47f8-8cd1-0f893a675070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:53.099271 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3c922-dcfd-47f8-8cd1-0f893a675070 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:53.099535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3c922-dcfd-47f8-8cd1-0f893a675070 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:53.099816 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3c922-dcfd-47f8-8cd1-0f893a675070 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:53.100498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3c922-dcfd-47f8-8cd1-0f893a675070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:53.100800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3c922-dcfd-47f8-8cd1-0f893a675070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:53.102266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3c922-dcfd-47f8-8cd1-0f893a675070 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:53.114779 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 624/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:53.120808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:53.220920 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:53.229560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5458-324a-49c8-ab6b-892dcff8adac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:53.263760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66860bdd-6036-4ab4-a6e0-dc350833c077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:53.264420 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66860bdd-6036-4ab4-a6e0-dc350833c077 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:53.264693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66860bdd-6036-4ab4-a6e0-dc350833c077 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:53.264960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66860bdd-6036-4ab4-a6e0-dc350833c077 None admin] PATH_INFO: `/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/a8711bb78a6e4077aad9f5491c38173b/roles/b090998fe8bf4daaaa0b915ba057d4d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:53.266838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66860bdd-6036-4ab4-a6e0-dc350833c077 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7f72fad4e743f8b3294a3e754210f4, user_id=a8711bb78a6e4077aad9f5491c38173b, role_id=b090998fe8bf4daaaa0b915ba057d4d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:53.268240 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66860bdd-6036-4ab4-a6e0-dc350833c077 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:53.280940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 649/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 22 02:36:53 2022] PUT /identity/v3/projects/bb7f72fad4e743f8b3294a3e754210f4/users/a8711bb78a6e4077aad9f5491c38173b/roles/b090998fe8bf4daaaa0b915ba057d4d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:36:55.467600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a186fd0-a8c7-42e9-a832-0be65c6f3c3c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:55.468140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a186fd0-a8c7-42e9-a832-0be65c6f3c3c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:55.468140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a186fd0-a8c7-42e9-a832-0be65c6f3c3c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:55.469482 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 625/1274] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:36:55.475182 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429e01d-36bd-4803-92c6-1430fb540dc2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:55.475604 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429e01d-36bd-4803-92c6-1430fb540dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:55.475736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429e01d-36bd-4803-92c6-1430fb540dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:55.493551 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0429e01d-36bd-4803-92c6-1430fb540dc2 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:36:55.494786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0429e01d-36bd-4803-92c6-1430fb540dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:36:55.567308 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 650/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:36:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 02:36:55.847801 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a186fd0-a8c7-42e9-a832-0be65c6f3c3c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:55.954001 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a186fd0-a8c7-42e9-a832-0be65c6f3c3c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:55.970744 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:55.987011 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:55.988124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:55.988398 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:55.988667 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:55.998471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 02:36:56.003805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:56.004880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:56.006085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 626/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 22 02:36:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 02:36:56.010917 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429e01d-36bd-4803-92c6-1430fb540dc2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:56.088969 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:56.106791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429e01d-36bd-4803-92c6-1430fb540dc2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:56.139758 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:56.140355 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:56.140630 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:56.140896 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:56.141546 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:56.141871 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:56.143219 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:56.151083 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 651/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 22 02:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:56.156919 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:56.256870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771191-9bb5-4e4e-a3c3-0e58eecfdad8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:56.291929 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:56.292553 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:56.292830 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:56.293099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:56.303895 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:56.305317 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:56.319643 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:56.320806 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:56.321933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:56.321933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:56.321933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:56.321933 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 627/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:56.327293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:56.427666 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91cb7c-20d7-4a2b-afa1-eaeae21f6c96 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:56.459652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:56.460253 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:56.460532 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:56.460804 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:56.461438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:56.461767 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:56.463118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:56.475180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 652/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:56.480902 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:56.511627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:56.584696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d408ec-2299-44b3-940a-940fc973adda None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:56.621574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:56.622571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:56.622571 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:56.622751 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:56.630658 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:56.632086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 02:36:56.643028 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:56.644591 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:36:56.645616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 628/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:56.650615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:56.654545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:56.752736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e5b58-bb1e-46bb-a3f9-266526653eae None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:56.786296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:56.786901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:56.787182 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:56.787458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:56.788188 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:56.788495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:56.789930 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:56.807807 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 653/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 22 02:36:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:56.813930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:56.904820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:56.915323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc12987-394c-4431-8aee-b27ddc5befb1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:56.948473 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:56.949074 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:56.949350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:56.949619 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:57.015385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:57.016733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:57.104155 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:57.114572 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 629/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 22 02:36:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 02:36:57.120480 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:57.182749 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:57.221798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa869a-2f78-45ba-95dc-48dcd9e9b84d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:57.254871 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e09e9-e711-4052-b899-d238f064198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:57.255496 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e09e9-e711-4052-b899-d238f064198c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:57.255775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e09e9-e711-4052-b899-d238f064198c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:57.256048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e09e9-e711-4052-b899-d238f064198c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:57.265742 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e09e9-e711-4052-b899-d238f064198c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:57.267108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e09e9-e711-4052-b899-d238f064198c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-893e09e9-e711-4052-b899-d238f064198c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 02:36:57.281639 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:57.282751 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 02:36:57.283972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 02:36:57.283972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 02:36:57.283972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:57.283972 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 654/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:57.288638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:57.386263 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73340cb9-6db5-4690-beba-c47a4887318e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:57.419268 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:57.419861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:57.420134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:57.420400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:57.421027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:57.421325 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:57.422708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:57.434817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 630/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 22 02:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:57.441235 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e09e9-e711-4052-b899-d238f064198c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:57.539275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e09e9-e711-4052-b899-d238f064198c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:57.554531 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:57.576164 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:57.576800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:57.577074 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:57.577342 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:57.584177 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:57.585586 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 02:36:57.596411 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:36:57.597434 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 22 02:36:57.598671 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 655/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 22 02:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:36:57.603393 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:57.654319 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:36:57.709312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958804-4b50-4d36-abb7-e2bf8340e75f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:57.742629 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06c443-05f4-4791-878a-6c87bd548422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:57.743238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06c443-05f4-4791-878a-6c87bd548422 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:57.743518 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06c443-05f4-4791-878a-6c87bd548422 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:57.743792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06c443-05f4-4791-878a-6c87bd548422 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:57.744476 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06c443-05f4-4791-878a-6c87bd548422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:57.744783 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06c443-05f4-4791-878a-6c87bd548422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:57.746238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06c443-05f4-4791-878a-6c87bd548422 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:57.759515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 631/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 22 02:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:36:57.765713 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:36:57.864951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590cd9c-f42c-47a7-97c9-d3eb7ecde1de None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:36:57.898741 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71358f3-c2aa-405f-98b5-32d482159fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:36:57.899344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71358f3-c2aa-405f-98b5-32d482159fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:36:57.899624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71358f3-c2aa-405f-98b5-32d482159fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:36:57.899900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71358f3-c2aa-405f-98b5-32d482159fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:36:57.900618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71358f3-c2aa-405f-98b5-32d482159fc5 None admin] RBAC: Adding query filter params (role.id=b090998fe8bf4daaaa0b915ba057d4d8, scope.project.id=bb7f72fad4e743f8b3294a3e754210f4, user.id=a8711bb78a6e4077aad9f5491c38173b) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:36:57.900926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71358f3-c2aa-405f-98b5-32d482159fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:36:57.902373 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71358f3-c2aa-405f-98b5-32d482159fc5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:36:57.908097 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 656/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 22 02:36:57 2022] GET /identity/v3/role_assignments?user.id=a8711bb78a6e4077aad9f5491c38173b&scope.project.id=bb7f72fad4e743f8b3294a3e754210f4&role.id=b090998fe8bf4daaaa0b915ba057d4d8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:37:00.086122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b051-5fb5-4fc3-bb88-a0018c3a00ad None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:00.086678 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b051-5fb5-4fc3-bb88-a0018c3a00ad None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:00.086678 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b051-5fb5-4fc3-bb88-a0018c3a00ad None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:00.088032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 632/1288] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:37:00.094099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ff2d5-e6c3-47c6-998f-e8269adee9e0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:00.094618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ff2d5-e6c3-47c6-998f-e8269adee9e0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:00.094618 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ff2d5-e6c3-47c6-998f-e8269adee9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:00.114329 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-469ff2d5-e6c3-47c6-998f-e8269adee9e0 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:37:00.115524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-469ff2d5-e6c3-47c6-998f-e8269adee9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:37:00.143685 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:00.181076 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 657/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:37:00.449410 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b051-5fb5-4fc3-bb88-a0018c3a00ad None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:00.555595 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b051-5fb5-4fc3-bb88-a0018c3a00ad None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:00.573502 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:00.600891 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:00.601521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:00.601830 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:00.602153 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:00.602741 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:00.604143 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:37:00.613545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:37:00.614786 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:00.615955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 633/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:37:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:37:00.620871 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ff2d5-e6c3-47c6-998f-e8269adee9e0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:00.726475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ff2d5-e6c3-47c6-998f-e8269adee9e0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:00.760170 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e96c-13ff-4301-9eea-6f67102b6ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:00.760775 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e96c-13ff-4301-9eea-6f67102b6ace None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:00.761059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e96c-13ff-4301-9eea-6f67102b6ace None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:00.761635 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e96c-13ff-4301-9eea-6f67102b6ace None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:00.762293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7e96c-13ff-4301-9eea-6f67102b6ace None admin] RBAC: Adding query filter params (name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:37:00.762597 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7e96c-13ff-4301-9eea-6f67102b6ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:00.763952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7e96c-13ff-4301-9eea-6f67102b6ace None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:00.769287 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 658/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 22 02:37:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:37:00.775179 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:00.875278 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc08e17-71a0-470b-b5be-b227b63085a6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:00.910098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053ff91-446f-43c4-9a26-a656718a1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:00.910696 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ff91-446f-43c4-9a26-a656718a1b0c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:00.910972 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ff91-446f-43c4-9a26-a656718a1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:00.911242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ff91-446f-43c4-9a26-a656718a1b0c None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:00.911861 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053ff91-446f-43c4-9a26-a656718a1b0c None admin] RBAC: Adding query filter params (type=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:37:00.912161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053ff91-446f-43c4-9a26-a656718a1b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:00.913528 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053ff91-446f-43c4-9a26-a656718a1b0c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:00.917980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 634/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 22 02:37:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:37:03.066934 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194828-9cdf-40e3-8dfa-91b2ead8dcf7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:03.067475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194828-9cdf-40e3-8dfa-91b2ead8dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:03.067475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194828-9cdf-40e3-8dfa-91b2ead8dcf7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:03.068820 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 659/1293] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:37:03.073980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04275a02-942f-4d13-8dfd-ba0ecd500102 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:03.074405 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04275a02-942f-4d13-8dfd-ba0ecd500102 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:03.074521 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04275a02-942f-4d13-8dfd-ba0ecd500102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:03.092238 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-04275a02-942f-4d13-8dfd-ba0ecd500102 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:37:03.093415 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-04275a02-942f-4d13-8dfd-ba0ecd500102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:37:03.123231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:03.160014 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 635/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:37:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:37:03.432606 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55194828-9cdf-40e3-8dfa-91b2ead8dcf7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:03.463396 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:03.535398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55194828-9cdf-40e3-8dfa-91b2ead8dcf7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:03.572030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062b0c6-a6ae-4088-a26f-b735400f05bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:03.572629 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062b0c6-a6ae-4088-a26f-b735400f05bf None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:03.572903 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062b0c6-a6ae-4088-a26f-b735400f05bf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:03.573173 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062b0c6-a6ae-4088-a26f-b735400f05bf None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:03.573853 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062b0c6-a6ae-4088-a26f-b735400f05bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:03.575193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062b0c6-a6ae-4088-a26f-b735400f05bf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:03.591053 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 660/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 22 02:37:03 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:37:05.883025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814cd1-dbd1-446d-a115-b30f2efefbf4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:05.883545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814cd1-dbd1-446d-a115-b30f2efefbf4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:05.883545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814cd1-dbd1-446d-a115-b30f2efefbf4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:05.884815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 636/1296] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:37:05.890176 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dc6fb-566e-4de1-9386-75e659022182 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:05.890561 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dc6fb-566e-4de1-9386-75e659022182 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:05.890724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dc6fb-566e-4de1-9386-75e659022182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:05.908405 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3a1dc6fb-566e-4de1-9386-75e659022182 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:37:05.909584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3a1dc6fb-566e-4de1-9386-75e659022182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:37:05.979805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 661/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:37:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:37:06.258102 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56814cd1-dbd1-446d-a115-b30f2efefbf4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:06.363397 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56814cd1-dbd1-446d-a115-b30f2efefbf4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:06.396717 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:06.397337 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:06.397608 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:06.397905 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:06.398474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:06.399817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:37:06.408312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:37:06.409491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:06.410555 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 637/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:37:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:37:06.415585 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dc6fb-566e-4de1-9386-75e659022182 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:06.433812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:06.513715 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dc6fb-566e-4de1-9386-75e659022182 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:06.548873 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:06.549471 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:06.550277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:06.550546 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:06.551168 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:37:06.551462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:06.552812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:06.557820 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 662/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 22 02:37:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:37:06.563773 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:06.594986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:06.662266 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08cfa-2698-40f8-ba4f-489b00859656 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:06.695262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317a86e-9c36-4753-9c8f-f38486598b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:06.695886 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a86e-9c36-4753-9c8f-f38486598b22 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:06.696164 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a86e-9c36-4753-9c8f-f38486598b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:06.696430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a86e-9c36-4753-9c8f-f38486598b22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:06.697121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a86e-9c36-4753-9c8f-f38486598b22 None admin] RBAC: Adding query filter params (interface=public, service_id=f7e3d63130d745c884b77fb7ed42bd8f, region_id=RegionOne) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:37:06.697433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a86e-9c36-4753-9c8f-f38486598b22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:06.698820 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a86e-9c36-4753-9c8f-f38486598b22 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:06.703623 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 638/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 22 02:37:06 2022] GET /identity/v3/endpoints?service_id=f7e3d63130d745c884b77fb7ed42bd8f&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:37:06.709275 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:06.787653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:06.806037 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c1a90-1dc6-43c1-aa5a-b9cc58deb12b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:06.838693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c19d8b-afa3-4e94-8b49-bef2ac7d80d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:06.839289 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c19d8b-afa3-4e94-8b49-bef2ac7d80d7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:06.839562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c19d8b-afa3-4e94-8b49-bef2ac7d80d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:06.839834 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c19d8b-afa3-4e94-8b49-bef2ac7d80d7 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:06.840430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c19d8b-afa3-4e94-8b49-bef2ac7d80d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:06.841804 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c19d8b-afa3-4e94-8b49-bef2ac7d80d7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:06.848979 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 663/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 22 02:37:06 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:37:08.987091 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8278-ced6-4a12-91f7-94ebd003064d None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:08.987627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8278-ced6-4a12-91f7-94ebd003064d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:08.987627 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8278-ced6-4a12-91f7-94ebd003064d None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:08.988974 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 639/1302] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:37:08.994184 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb270fe1-f066-4d8c-966b-79673ddb7a83 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:08.994632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb270fe1-f066-4d8c-966b-79673ddb7a83 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:08.994725 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb270fe1-f066-4d8c-966b-79673ddb7a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:09.012951 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cb270fe1-f066-4d8c-966b-79673ddb7a83 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:37:09.014179 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cb270fe1-f066-4d8c-966b-79673ddb7a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:37:09.092031 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 664/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:37:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 02:37:09.356086 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8278-ced6-4a12-91f7-94ebd003064d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:09.453921 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:09.461348 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8278-ced6-4a12-91f7-94ebd003064d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:09.494042 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:09.494659 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:09.494935 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:09.495208 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:09.495774 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:09.497123 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 02:37:09.505688 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 02:37:09.506871 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 22 02:37:09.508080 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 640/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 22 02:37:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 02:37:09.512786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb270fe1-f066-4d8c-966b-79673ddb7a83 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:09.589830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:09.612940 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb270fe1-f066-4d8c-966b-79673ddb7a83 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:09.646052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7dc51-4887-4510-a396-43b257da21f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:09.646664 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7dc51-4887-4510-a396-43b257da21f5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:09.646943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7dc51-4887-4510-a396-43b257da21f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:09.647215 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7dc51-4887-4510-a396-43b257da21f5 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:09.647840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7dc51-4887-4510-a396-43b257da21f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:37:09.648143 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7dc51-4887-4510-a396-43b257da21f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:09.649489 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7dc51-4887-4510-a396-43b257da21f5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:09.654530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 665/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 22 02:37:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:37:09.660876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:37:09.757209 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc834-05ff-4c88-99bc-51a7b400c5fc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:37:09.789876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d27f9-c76c-4a14-97c3-8821f2d9256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:37:09.790469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d27f9-c76c-4a14-97c3-8821f2d9256a None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:37:09.790747 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d27f9-c76c-4a14-97c3-8821f2d9256a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:37:09.791016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d27f9-c76c-4a14-97c3-8821f2d9256a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:37:09.791666 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d27f9-c76c-4a14-97c3-8821f2d9256a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:37:09.793020 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d27f9-c76c-4a14-97c3-8821f2d9256a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:37:09.812267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 641/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:37:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:37:19.651615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=30 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:37:19.808289 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:18.306242 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f3a57-9fbb-4324-8d93-3c71f5268202 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:18.307147 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f3a57-9fbb-4324-8d93-3c71f5268202 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:18.307596 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f3a57-9fbb-4324-8d93-3c71f5268202 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:18.313292 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 666/1307] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:18.315818 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a82da-14dc-4831-a181-538fd6815f69 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:18.316285 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a82da-14dc-4831-a181-538fd6815f69 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:18.316743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a82da-14dc-4831-a181-538fd6815f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:18.464670 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d34a82da-14dc-4831-a181-538fd6815f69 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:18.466251 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d34a82da-14dc-4831-a181-538fd6815f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:18.625707 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 642/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:18.937626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7d095-c631-4735-960c-a8c4d74fdcc4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:18.937944 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7d095-c631-4735-960c-a8c4d74fdcc4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:18.938224 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7d095-c631-4735-960c-a8c4d74fdcc4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:18.939919 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 667/1309] 10.222.0.57 () {54 vars in 963 bytes} [Thu Sep 22 02:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:18.947344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0871cf-a3cc-4db4-8515-0b31a6721c84 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:18.948435 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0871cf-a3cc-4db4-8515-0b31a6721c84 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:18.949210 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0871cf-a3cc-4db4-8515-0b31a6721c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:19.119464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ec0871cf-a3cc-4db4-8515-0b31a6721c84 None None] MFA Rules not processed for user `5cb868fc365140a39e3f64166df3e1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:19.122199 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ec0871cf-a3cc-4db4-8515-0b31a6721c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:19.175534 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:19.302490 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 643/1310] 10.222.0.57 () {58 vars in 1060 bytes} [Thu Sep 22 02:38:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:19.311626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7d095-c631-4735-960c-a8c4d74fdcc4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:19.314228 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d2a7d095-c631-4735-960c-a8c4d74fdcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:19.503446 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7d095-c631-4735-960c-a8c4d74fdcc4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:19.688149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8af99c-9495-4955-b2df-3377177aaa93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:19.689163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af99c-9495-4955-b2df-3377177aaa93 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:19.689630 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af99c-9495-4955-b2df-3377177aaa93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:19.690109 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af99c-9495-4955-b2df-3377177aaa93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:19.693005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9c8af99c-9495-4955-b2df-3377177aaa93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:19.828277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:19.959281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8af99c-9495-4955-b2df-3377177aaa93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:19.960961 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8af99c-9495-4955-b2df-3377177aaa93 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:20.001220 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 668/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:22.533565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87306ae6-6997-40cf-af55-41de73e742f5 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:22.534182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87306ae6-6997-40cf-af55-41de73e742f5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:22.534182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87306ae6-6997-40cf-af55-41de73e742f5 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:22.535616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 644/1312] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:38:22.541797 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351397-e861-4c00-b90e-f864967eeec7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:22.542562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351397-e861-4c00-b90e-f864967eeec7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:22.542562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351397-e861-4c00-b90e-f864967eeec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:22.634311 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-18351397-e861-4c00-b90e-f864967eeec7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:22.635591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-18351397-e861-4c00-b90e-f864967eeec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:22.790562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 669/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:23.359723 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8979e0-194b-487f-be1e-9cc6fa587fcd None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:23.360048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8979e0-194b-487f-be1e-9cc6fa587fcd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:23.360365 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8979e0-194b-487f-be1e-9cc6fa587fcd None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:23.361787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 645/1314] 10.222.0.57 () {54 vars in 963 bytes} [Thu Sep 22 02:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:38:23.368827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08987fd-d6d0-4717-81e9-ff81d3abe321 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:23.369293 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08987fd-d6d0-4717-81e9-ff81d3abe321 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:23.369760 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08987fd-d6d0-4717-81e9-ff81d3abe321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:23.389843 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:23.497537 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b08987fd-d6d0-4717-81e9-ff81d3abe321 None None] MFA Rules not processed for user `5cb868fc365140a39e3f64166df3e1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:23.499391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b08987fd-d6d0-4717-81e9-ff81d3abe321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:23.596159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 670/1315] 10.222.0.57 () {58 vars in 1060 bytes} [Thu Sep 22 02:38:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:23.606031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8979e0-194b-487f-be1e-9cc6fa587fcd None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:23.607704 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3b8979e0-194b-487f-be1e-9cc6fa587fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:23.740376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8979e0-194b-487f-be1e-9cc6fa587fcd None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:23.847545 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:23.850168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057aca8-1421-4ceb-8d1c-031a52446230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:23.851041 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057aca8-1421-4ceb-8d1c-031a52446230 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:23.851395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057aca8-1421-4ceb-8d1c-031a52446230 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:23.851881 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057aca8-1421-4ceb-8d1c-031a52446230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:23.853823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5057aca8-1421-4ceb-8d1c-031a52446230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:23.973949 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057aca8-1421-4ceb-8d1c-031a52446230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:23.975390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057aca8-1421-4ceb-8d1c-031a52446230 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:23.994708 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 646/1316] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:26.991724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971ec1-64e4-4a09-a53d-7fe1b8fc49c9 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:26.992287 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971ec1-64e4-4a09-a53d-7fe1b8fc49c9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:26.992287 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971ec1-64e4-4a09-a53d-7fe1b8fc49c9 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:26.993693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 671/1317] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:26.999963 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18c79-c69c-4e28-8cf1-422a0c2960d7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:27.000568 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18c79-c69c-4e28-8cf1-422a0c2960d7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:27.000568 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18c79-c69c-4e28-8cf1-422a0c2960d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:27.076544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-dbb18c79-c69c-4e28-8cf1-422a0c2960d7 None None] MFA Rules not processed for user `0d8f08b6a27347c1b6a0be2724b6aed0`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:27.077814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-dbb18c79-c69c-4e28-8cf1-422a0c2960d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:27.135164 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:27.180776 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 647/1318] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:27.475538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f971ec1-64e4-4a09-a53d-7fe1b8fc49c9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:27.477296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6f971ec1-64e4-4a09-a53d-7fe1b8fc49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:27.582048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f971ec1-64e4-4a09-a53d-7fe1b8fc49c9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:27.584923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:27.668160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4111-44bd-4b25-9802-1ba611d4e9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:27.668768 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4111-44bd-4b25-9802-1ba611d4e9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:27.669045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4111-44bd-4b25-9802-1ba611d4e9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:27.669314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4111-44bd-4b25-9802-1ba611d4e9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:27.671224 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-409b4111-44bd-4b25-9802-1ba611d4e9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:27.779258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4111-44bd-4b25-9802-1ba611d4e9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:27.780594 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4111-44bd-4b25-9802-1ba611d4e9d9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:27.798848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 672/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:30.534478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe93875-b6ec-4f69-b219-ac3e15d9dd25 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:30.535012 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe93875-b6ec-4f69-b219-ac3e15d9dd25 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:30.535129 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe93875-b6ec-4f69-b219-ac3e15d9dd25 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:30.536380 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 648/1320] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:30.541739 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88587e7-745a-4756-aa7a-cb6ceae63a2a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:30.542279 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88587e7-745a-4756-aa7a-cb6ceae63a2a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:30.542387 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88587e7-745a-4756-aa7a-cb6ceae63a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:30.584281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:30.610518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b88587e7-745a-4756-aa7a-cb6ceae63a2a None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:30.611732 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b88587e7-745a-4756-aa7a-cb6ceae63a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:30.708957 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 673/1321] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:30.992907 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe93875-b6ec-4f69-b219-ac3e15d9dd25 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:30.994503 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cfe93875-b6ec-4f69-b219-ac3e15d9dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:31.115779 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe93875-b6ec-4f69-b219-ac3e15d9dd25 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:31.194583 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981650ce-b86e-496c-a7c5-46e956d6f819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:31.195198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981650ce-b86e-496c-a7c5-46e956d6f819 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:31.195475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981650ce-b86e-496c-a7c5-46e956d6f819 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:31.195744 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981650ce-b86e-496c-a7c5-46e956d6f819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:31.197442 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-981650ce-b86e-496c-a7c5-46e956d6f819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:31.205249 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:31.312793 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981650ce-b86e-496c-a7c5-46e956d6f819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:31.314876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981650ce-b86e-496c-a7c5-46e956d6f819 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:31.332915 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 649/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:34.215045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897754-758b-476a-a87b-b77d8234ba02 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:34.215648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897754-758b-476a-a87b-b77d8234ba02 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:34.215648 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897754-758b-476a-a87b-b77d8234ba02 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:34.217000 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 674/1323] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:34.222488 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276973-2e3e-435a-b1fa-38e98a76eda6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:34.222917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276973-2e3e-435a-b1fa-38e98a76eda6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:34.223107 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276973-2e3e-435a-b1fa-38e98a76eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:34.297138 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c0276973-2e3e-435a-b1fa-38e98a76eda6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:34.298960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c0276973-2e3e-435a-b1fa-38e98a76eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:34.361910 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:34.405746 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 650/1324] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:34.698518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0897754-758b-476a-a87b-b77d8234ba02 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:34.700045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e0897754-758b-476a-a87b-b77d8234ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:34.805631 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0897754-758b-476a-a87b-b77d8234ba02 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:34.819518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:34.881243 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31fb3d-d1b2-4dfc-9deb-a45950f5cc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:34.881786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31fb3d-d1b2-4dfc-9deb-a45950f5cc1b service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:34.882095 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31fb3d-d1b2-4dfc-9deb-a45950f5cc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:34.882368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31fb3d-d1b2-4dfc-9deb-a45950f5cc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:34.883985 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2b31fb3d-d1b2-4dfc-9deb-a45950f5cc1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:34.998453 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31fb3d-d1b2-4dfc-9deb-a45950f5cc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:34.999885 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31fb3d-d1b2-4dfc-9deb-a45950f5cc1b service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:35.018520 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 675/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:37.277227 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f8b68-dbaa-47ff-9afa-c3dc801f75ed None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:37.277829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f8b68-dbaa-47ff-9afa-c3dc801f75ed None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:37.277829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f8b68-dbaa-47ff-9afa-c3dc801f75ed None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:37.279182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 651/1326] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:37.284982 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166829d-1d12-437e-9722-1605a92e8eca None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:37.285524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166829d-1d12-437e-9722-1605a92e8eca None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:37.285524 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166829d-1d12-437e-9722-1605a92e8eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:37.341500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:37.364495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a166829d-1d12-437e-9722-1605a92e8eca None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:37.365745 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a166829d-1d12-437e-9722-1605a92e8eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:37.494422 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 676/1327] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:37.781458 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f8b68-dbaa-47ff-9afa-c3dc801f75ed None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:37.784334 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e92f8b68-dbaa-47ff-9afa-c3dc801f75ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:37.898515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f8b68-dbaa-47ff-9afa-c3dc801f75ed None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:37.981799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bedf13-0a3d-48f2-a3a0-d23cf09fc8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:37.982410 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bedf13-0a3d-48f2-a3a0-d23cf09fc8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:37.982687 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bedf13-0a3d-48f2-a3a0-d23cf09fc8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:37.982958 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bedf13-0a3d-48f2-a3a0-d23cf09fc8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:37.984574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d6bedf13-0a3d-48f2-a3a0-d23cf09fc8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:38.004126 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:38.105913 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bedf13-0a3d-48f2-a3a0-d23cf09fc8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:38.107265 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bedf13-0a3d-48f2-a3a0-d23cf09fc8e9 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:38.125505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 652/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:40.440110 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9bd84-222b-491c-b908-65005f985687 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:40.440528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9bd84-222b-491c-b908-65005f985687 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:40.440615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9bd84-222b-491c-b908-65005f985687 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:40.443393 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 677/1329] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:40.447792 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068efcec-36a5-4fc8-a1d6-427fe10199bb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:40.448230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068efcec-36a5-4fc8-a1d6-427fe10199bb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:40.448323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068efcec-36a5-4fc8-a1d6-427fe10199bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:40.522378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-068efcec-36a5-4fc8-a1d6-427fe10199bb None None] MFA Rules not processed for user `0d8f08b6a27347c1b6a0be2724b6aed0`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:40.523614 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-068efcec-36a5-4fc8-a1d6-427fe10199bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:40.607388 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:40.644755 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 653/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:40.931312 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9bd84-222b-491c-b908-65005f985687 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:40.932862 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-61e9bd84-222b-491c-b908-65005f985687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:41.054103 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9bd84-222b-491c-b908-65005f985687 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:41.078050 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:41.139241 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b044c1c-2b97-42a1-96e1-44b66ccb981d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:41.139883 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b044c1c-2b97-42a1-96e1-44b66ccb981d service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:41.140160 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b044c1c-2b97-42a1-96e1-44b66ccb981d service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:41.140437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b044c1c-2b97-42a1-96e1-44b66ccb981d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:41.142281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4b044c1c-2b97-42a1-96e1-44b66ccb981d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:41.262261 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b044c1c-2b97-42a1-96e1-44b66ccb981d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:41.263663 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b044c1c-2b97-42a1-96e1-44b66ccb981d service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:41.283109 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 678/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:43.968218 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909be2-5e3c-441d-b6da-f574cf7a480d None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:43.968768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909be2-5e3c-441d-b6da-f574cf7a480d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:43.968768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909be2-5e3c-441d-b6da-f574cf7a480d None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:43.970170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 654/1332] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:43.975570 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d0777-4ef6-4e77-bf1d-922f6ec1a72a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:43.976009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d0777-4ef6-4e77-bf1d-922f6ec1a72a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:43.976121 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d0777-4ef6-4e77-bf1d-922f6ec1a72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:44.040748 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:44.043721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2f0d0777-4ef6-4e77-bf1d-922f6ec1a72a None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:44.045790 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2f0d0777-4ef6-4e77-bf1d-922f6ec1a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:44.150728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 679/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:44.434219 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89909be2-5e3c-441d-b6da-f574cf7a480d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:44.435814 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-89909be2-5e3c-441d-b6da-f574cf7a480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:44.542768 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89909be2-5e3c-441d-b6da-f574cf7a480d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:44.620765 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f4345-c48c-4144-a97a-30e2fe759951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:44.621378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f4345-c48c-4144-a97a-30e2fe759951 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:44.621674 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f4345-c48c-4144-a97a-30e2fe759951 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:44.621959 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f4345-c48c-4144-a97a-30e2fe759951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:44.623586 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-235f4345-c48c-4144-a97a-30e2fe759951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:44.653469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:44.742412 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f4345-c48c-4144-a97a-30e2fe759951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:44.745067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f4345-c48c-4144-a97a-30e2fe759951 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:44.777396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 655/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:47.035255 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d86c-2333-4e81-83ab-bcbd145e8733 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:47.035890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d86c-2333-4e81-83ab-bcbd145e8733 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:47.035890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d86c-2333-4e81-83ab-bcbd145e8733 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:47.037272 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 680/1335] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:47.043341 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34a770-916e-4ebd-8a57-14fa3285067b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:47.043925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34a770-916e-4ebd-8a57-14fa3285067b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:47.043925 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34a770-916e-4ebd-8a57-14fa3285067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:47.109583 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ad34a770-916e-4ebd-8a57-14fa3285067b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:47.110815 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ad34a770-916e-4ebd-8a57-14fa3285067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:47.183862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:47.206194 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 656/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:38:47.499728 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d86c-2333-4e81-83ab-bcbd145e8733 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:47.501809 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0e43d86c-2333-4e81-83ab-bcbd145e8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:47.611408 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d86c-2333-4e81-83ab-bcbd145e8733 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:47.642119 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:47.687598 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58dc2d-e825-400e-925a-163e3f8ae72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:47.688765 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58dc2d-e825-400e-925a-163e3f8ae72d service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:47.689046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58dc2d-e825-400e-925a-163e3f8ae72d service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:47.689318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58dc2d-e825-400e-925a-163e3f8ae72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:47.690968 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9a58dc2d-e825-400e-925a-163e3f8ae72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:47.798883 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58dc2d-e825-400e-925a-163e3f8ae72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:47.800230 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58dc2d-e825-400e-925a-163e3f8ae72d service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:47.819153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 681/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:50.483287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00749dd1-3187-4b94-a022-2f1c4964a93f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:50.483829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00749dd1-3187-4b94-a022-2f1c4964a93f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:50.483829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00749dd1-3187-4b94-a022-2f1c4964a93f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:50.485754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 657/1338] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:50.491042 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4088d-1939-42d9-b157-2bb387cc8cb8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:50.491519 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4088d-1939-42d9-b157-2bb387cc8cb8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:50.491626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4088d-1939-42d9-b157-2bb387cc8cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:50.561165 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fca4088d-1939-42d9-b157-2bb387cc8cb8 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:50.562325 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fca4088d-1939-42d9-b157-2bb387cc8cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:50.571092 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:50.660336 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 682/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:50.942396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00749dd1-3187-4b94-a022-2f1c4964a93f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:50.943983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-00749dd1-3187-4b94-a022-2f1c4964a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:51.048663 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00749dd1-3187-4b94-a022-2f1c4964a93f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:51.120982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adef91-8faf-47af-853a-8b953d8358b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:51.121577 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adef91-8faf-47af-853a-8b953d8358b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:51.121890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adef91-8faf-47af-853a-8b953d8358b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:51.122159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adef91-8faf-47af-853a-8b953d8358b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:51.123738 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b7adef91-8faf-47af-853a-8b953d8358b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:51.159189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:51.235042 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adef91-8faf-47af-853a-8b953d8358b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:51.236428 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adef91-8faf-47af-853a-8b953d8358b7 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:51.258342 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 658/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:55.478297 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f396f-61e2-4523-9d6d-e7344c99b020 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:55.478816 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f396f-61e2-4523-9d6d-e7344c99b020 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:55.478934 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f396f-61e2-4523-9d6d-e7344c99b020 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:55.480628 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 683/1341] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:55.486322 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97aba-5ae3-4242-9822-8868f57ccec1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:55.486785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97aba-5ae3-4242-9822-8868f57ccec1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:55.486900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97aba-5ae3-4242-9822-8868f57ccec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:55.567133 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-69c97aba-5ae3-4242-9822-8868f57ccec1 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:55.568408 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-69c97aba-5ae3-4242-9822-8868f57ccec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:55.674707 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:55.688190 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 659/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:38:55.972624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f396f-61e2-4523-9d6d-e7344c99b020 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:38:55.974386 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b84f396f-61e2-4523-9d6d-e7344c99b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:56.085271 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f396f-61e2-4523-9d6d-e7344c99b020 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:38:56.130608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:56.167948 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1537c93-cb73-4d26-997c-51dacce248a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:38:56.168566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537c93-cb73-4d26-997c-51dacce248a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:56.168843 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537c93-cb73-4d26-997c-51dacce248a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:56.169113 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537c93-cb73-4d26-997c-51dacce248a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:56.171037 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d1537c93-cb73-4d26-997c-51dacce248a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:56.292180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1537c93-cb73-4d26-997c-51dacce248a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:38:56.293523 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1537c93-cb73-4d26-997c-51dacce248a9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:38:56.313216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 684/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:38:59.502869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf2a67-9c59-4870-98e4-61ead0473b33 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:59.503413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf2a67-9c59-4870-98e4-61ead0473b33 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:59.503413 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf2a67-9c59-4870-98e4-61ead0473b33 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:59.504762 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 660/1344] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:38:59.510105 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e9b3-93f3-40a9-a02c-6deb0fb3facd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:38:59.510577 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e9b3-93f3-40a9-a02c-6deb0fb3facd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:38:59.510737 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e9b3-93f3-40a9-a02c-6deb0fb3facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:38:59.591687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-74c5e9b3-93f3-40a9-a02c-6deb0fb3facd None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:38:59.592923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-74c5e9b3-93f3-40a9-a02c-6deb0fb3facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:38:59.614866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:38:59.717349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 685/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:38:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:00.066284 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf2a67-9c59-4870-98e4-61ead0473b33 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:00.068560 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0ecf2a67-9c59-4870-98e4-61ead0473b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:00.185873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf2a67-9c59-4870-98e4-61ead0473b33 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:00.277584 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c58d8a-a62a-4f32-83ba-d9f16d379ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:00.278139 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58d8a-a62a-4f32-83ba-d9f16d379ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:00.278419 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58d8a-a62a-4f32-83ba-d9f16d379ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:00.278695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58d8a-a62a-4f32-83ba-d9f16d379ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:00.280349 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a9c58d8a-a62a-4f32-83ba-d9f16d379ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:00.331527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:00.418456 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c58d8a-a62a-4f32-83ba-d9f16d379ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:00.420168 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c58d8a-a62a-4f32-83ba-d9f16d379ba0 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:00.446605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 661/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:04.945795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff234f1-f029-4b2f-97fd-6dc7dee2c8b2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:04.946368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff234f1-f029-4b2f-97fd-6dc7dee2c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:04.946368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff234f1-f029-4b2f-97fd-6dc7dee2c8b2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:04.947710 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 686/1347] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:04.954997 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ce43-265f-4e79-8311-24edd99d7ab4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:04.955836 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ce43-265f-4e79-8311-24edd99d7ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:04.956134 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ce43-265f-4e79-8311-24edd99d7ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:05.041903 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ab20ce43-265f-4e79-8311-24edd99d7ab4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:05.043887 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ab20ce43-265f-4e79-8311-24edd99d7ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:05.162707 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:05.165438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 662/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:05.452729 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff234f1-f029-4b2f-97fd-6dc7dee2c8b2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:05.454798 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9ff234f1-f029-4b2f-97fd-6dc7dee2c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:05.571357 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff234f1-f029-4b2f-97fd-6dc7dee2c8b2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:05.630693 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:05.663672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69578993-20bc-405c-875f-7d9225e44078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:05.664287 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578993-20bc-405c-875f-7d9225e44078 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:05.664568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578993-20bc-405c-875f-7d9225e44078 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:05.664846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578993-20bc-405c-875f-7d9225e44078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:05.666567 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-69578993-20bc-405c-875f-7d9225e44078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:05.788126 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69578993-20bc-405c-875f-7d9225e44078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:05.789569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69578993-20bc-405c-875f-7d9225e44078 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:05.810040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 687/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:10.985795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03b91f-cdbb-4f2b-bac4-623c984b9d18 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:10.986220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03b91f-cdbb-4f2b-bac4-623c984b9d18 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:10.986220 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03b91f-cdbb-4f2b-bac4-623c984b9d18 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:10.987809 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 663/1350] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 22 02:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:10.993149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714129-930d-481a-a825-f1911c57f11b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:10.993608 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714129-930d-481a-a825-f1911c57f11b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:10.994394 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714129-930d-481a-a825-f1911c57f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:11.097176 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2a714129-930d-481a-a825-f1911c57f11b None None] MFA Rules not processed for user `a8711bb78a6e4077aad9f5491c38173b`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:11.098584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2a714129-930d-481a-a825-f1911c57f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:11.124025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:11.295180 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 688/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 22 02:39:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:16.072833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf84577-aa22-4cf2-8e89-9c88f84317c4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:16.073719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf84577-aa22-4cf2-8e89-9c88f84317c4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:16.074195 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf84577-aa22-4cf2-8e89-9c88f84317c4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:16.075730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 664/1352] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 22 02:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:16.082171 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf5fa8-e942-41dd-893d-d584f00626af None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:16.082929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf5fa8-e942-41dd-893d-d584f00626af None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:16.082929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf5fa8-e942-41dd-893d-d584f00626af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:16.212432 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-72bf5fa8-e942-41dd-893d-d584f00626af None None] MFA Rules not processed for user `a8711bb78a6e4077aad9f5491c38173b`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:16.214495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-72bf5fa8-e942-41dd-893d-d584f00626af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:16.338406 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:16.388203 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 689/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 22 02:39:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:39:17.758745 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f18102-38bb-4aa7-abf7-dbfdf1fda482 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:17.759582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f18102-38bb-4aa7-abf7-dbfdf1fda482 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:17.759582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f18102-38bb-4aa7-abf7-dbfdf1fda482 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:17.760941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 665/1354] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 22 02:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:17.767315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd03335-b999-4fd2-9088-5cb93bad06ab None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:17.768059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd03335-b999-4fd2-9088-5cb93bad06ab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:17.768451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd03335-b999-4fd2-9088-5cb93bad06ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:17.893869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bfd03335-b999-4fd2-9088-5cb93bad06ab None None] MFA Rules not processed for user `a8711bb78a6e4077aad9f5491c38173b`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:17.895027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bfd03335-b999-4fd2-9088-5cb93bad06ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:18.024146 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 690/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 22 02:39:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:22.225738 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26856541-7c19-4588-a271-ec376c70956e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:22.227873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26856541-7c19-4588-a271-ec376c70956e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:22.228419 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26856541-7c19-4588-a271-ec376c70956e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:22.230973 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 666/1356] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:22.237309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad138dc-57f5-4c51-a725-1ef31c34392b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:22.238237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad138dc-57f5-4c51-a725-1ef31c34392b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:22.238237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad138dc-57f5-4c51-a725-1ef31c34392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:22.283778 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:22.327806 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fad138dc-57f5-4c51-a725-1ef31c34392b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:22.329149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fad138dc-57f5-4c51-a725-1ef31c34392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:22.461116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 691/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:39:22.768385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbf54-65d3-4da8-bb71-b3dcf2c37b84 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:22.768656 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbf54-65d3-4da8-bb71-b3dcf2c37b84 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:22.769160 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbf54-65d3-4da8-bb71-b3dcf2c37b84 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:22.770690 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 667/1358] 10.222.0.57 () {54 vars in 965 bytes} [Thu Sep 22 02:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:22.778786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ae7c-23f8-4196-96d8-bed8eba3d4fb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:22.779268 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ae7c-23f8-4196-96d8-bed8eba3d4fb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:22.779712 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ae7c-23f8-4196-96d8-bed8eba3d4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:22.870805 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2ab0ae7c-23f8-4196-96d8-bed8eba3d4fb None None] MFA Rules not processed for user `94bfeac1fea64803913036131d3bc6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:22.872011 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2ab0ae7c-23f8-4196-96d8-bed8eba3d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:22.928202 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:23.000964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 692/1359] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Sep 22 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:23.008540 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bbf54-65d3-4da8-bb71-b3dcf2c37b84 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:23.010154 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7c3bbf54-65d3-4da8-bb71-b3dcf2c37b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:23.176017 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bbf54-65d3-4da8-bb71-b3dcf2c37b84 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:23.253898 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:23.299730 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53368a1-e24a-4b2f-8b38-f49cf313a3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:23.300336 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53368a1-e24a-4b2f-8b38-f49cf313a3e4 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:23.300612 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53368a1-e24a-4b2f-8b38-f49cf313a3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:23.300882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53368a1-e24a-4b2f-8b38-f49cf313a3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:23.302534 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f53368a1-e24a-4b2f-8b38-f49cf313a3e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:23.404409 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53368a1-e24a-4b2f-8b38-f49cf313a3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:23.406600 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53368a1-e24a-4b2f-8b38-f49cf313a3e4 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:23.428235 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 668/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:25.899129 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8f53-bf4e-4fef-9937-66d8d1d81f83 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:25.900038 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8f53-bf4e-4fef-9937-66d8d1d81f83 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:25.900318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8f53-bf4e-4fef-9937-66d8d1d81f83 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:25.901701 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 693/1361] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:25.907897 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a997e1-2b9c-4236-ae38-0b981a3b0ce6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:25.908529 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a997e1-2b9c-4236-ae38-0b981a3b0ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:25.908529 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a997e1-2b9c-4236-ae38-0b981a3b0ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:25.997350 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-82a997e1-2b9c-4236-ae38-0b981a3b0ce6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:25.998589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-82a997e1-2b9c-4236-ae38-0b981a3b0ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:26.051934 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:26.149689 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 669/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:26.465085 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8f53-bf4e-4fef-9937-66d8d1d81f83 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:26.470457 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-67ba8f53-bf4e-4fef-9937-66d8d1d81f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:26.719833 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8f53-bf4e-4fef-9937-66d8d1d81f83 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:26.731956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:26.898902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c78d62-e981-4fe3-aac6-ae47332782f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:26.899517 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78d62-e981-4fe3-aac6-ae47332782f8 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:26.900051 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78d62-e981-4fe3-aac6-ae47332782f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:26.900051 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78d62-e981-4fe3-aac6-ae47332782f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:26.901763 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-65c78d62-e981-4fe3-aac6-ae47332782f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:27.012099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c78d62-e981-4fe3-aac6-ae47332782f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:27.013724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c78d62-e981-4fe3-aac6-ae47332782f8 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:27.033463 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 694/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:29.745720 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecaf20-3454-44c0-82b9-172e105ad82a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:29.747070 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecaf20-3454-44c0-82b9-172e105ad82a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:29.747563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecaf20-3454-44c0-82b9-172e105ad82a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:29.750986 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 670/1364] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:29.757047 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b943a-193a-468d-9634-80771da6e874 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:29.757892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b943a-193a-468d-9634-80771da6e874 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:29.757892 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b943a-193a-468d-9634-80771da6e874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:29.792840 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:29.867410 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c72b943a-193a-468d-9634-80771da6e874 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:29.869776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c72b943a-193a-468d-9634-80771da6e874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:30.041736 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 695/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:30.521037 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d1593-b65e-475b-be3c-7885d2abc9d5 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:30.521694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d1593-b65e-475b-be3c-7885d2abc9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:30.521694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d1593-b65e-475b-be3c-7885d2abc9d5 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:30.523829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 671/1366] 10.222.0.57 () {54 vars in 965 bytes} [Thu Sep 22 02:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:30.531176 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12acb-a2b0-47fd-931c-9e22cb53a94b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:30.531690 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12acb-a2b0-47fd-931c-9e22cb53a94b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:30.532189 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12acb-a2b0-47fd-931c-9e22cb53a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:30.670672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-34c12acb-a2b0-47fd-931c-9e22cb53a94b None None] MFA Rules not processed for user `94bfeac1fea64803913036131d3bc6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:30.671862 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-34c12acb-a2b0-47fd-931c-9e22cb53a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:30.720582 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:30.837937 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 696/1367] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Sep 22 02:39:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:30.846171 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d1593-b65e-475b-be3c-7885d2abc9d5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:30.849404 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-968d1593-b65e-475b-be3c-7885d2abc9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:31.112301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97260ac-1b15-4f08-9573-bc454e7b433d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:31.112571 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97260ac-1b15-4f08-9573-bc454e7b433d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:31.113018 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97260ac-1b15-4f08-9573-bc454e7b433d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:31.114545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 697/1368] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:39:31.120898 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f8b4-5b02-43c7-a2d9-c902d6c7617d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:31.121248 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f8b4-5b02-43c7-a2d9-c902d6c7617d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:31.121451 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f8b4-5b02-43c7-a2d9-c902d6c7617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:31.147144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d1593-b65e-475b-be3c-7885d2abc9d5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:31.190048 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:31.213812 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f6f1f8b4-5b02-43c7-a2d9-c902d6c7617d None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:31.215153 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f6f1f8b4-5b02-43c7-a2d9-c902d6c7617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:31.347800 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82da3-305c-4a1f-beef-688766bf2e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:31.348430 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82da3-305c-4a1f-beef-688766bf2e00 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:31.348707 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82da3-305c-4a1f-beef-688766bf2e00 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:31.348980 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82da3-305c-4a1f-beef-688766bf2e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:31.350748 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-49d82da3-305c-4a1f-beef-688766bf2e00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:31.367008 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:31.376673 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 698/1369] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:39:31.504754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82da3-305c-4a1f-beef-688766bf2e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:31.507716 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82da3-305c-4a1f-beef-688766bf2e00 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:31.549957 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 672/1370] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:31.770149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbed00-7437-495b-a448-bd35d740aa5b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:31.770149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbed00-7437-495b-a448-bd35d740aa5b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:31.770149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbed00-7437-495b-a448-bd35d740aa5b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:31.770149 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 699/1371] 10.222.0.57 () {54 vars in 963 bytes} [Thu Sep 22 02:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:31.780117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836485-833c-4e0a-b9f8-70dbb5a4976d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:31.780611 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836485-833c-4e0a-b9f8-70dbb5a4976d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:31.781085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836485-833c-4e0a-b9f8-70dbb5a4976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:31.843114 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:31.918778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0b836485-833c-4e0a-b9f8-70dbb5a4976d None None] MFA Rules not processed for user `a5cf3b19d04044fda6a4aa1b5d7aff2c`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:31.920492 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0b836485-833c-4e0a-b9f8-70dbb5a4976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:32.016599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 673/1372] 10.222.0.57 () {58 vars in 1060 bytes} [Thu Sep 22 02:39:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:32.024546 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbed00-7437-495b-a448-bd35d740aa5b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:32.027576 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-08bbed00-7437-495b-a448-bd35d740aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:32.158727 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbed00-7437-495b-a448-bd35d740aa5b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:32.296596 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444a85-7847-470d-9c46-714e639375b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf3b19d04044fda6a4aa1b5d7aff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:32.298720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444a85-7847-470d-9c46-714e639375b0 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:32.298720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444a85-7847-470d-9c46-714e639375b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:32.298720 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444a85-7847-470d-9c46-714e639375b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:32.300581 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-38444a85-7847-470d-9c46-714e639375b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:32.371954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:32.476123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38444a85-7847-470d-9c46-714e639375b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:32.476123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38444a85-7847-470d-9c46-714e639375b0 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:32.514986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 700/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:33.910823 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6bdc0-ef4e-4189-896c-2f67c18a32d7 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:33.911659 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6bdc0-ef4e-4189-896c-2f67c18a32d7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:33.911659 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6bdc0-ef4e-4189-896c-2f67c18a32d7 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:33.913438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 674/1374] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:33.919222 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38ee52-32af-4869-96f3-de5242efcc89 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:33.919923 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38ee52-32af-4869-96f3-de5242efcc89 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:33.920056 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38ee52-32af-4869-96f3-de5242efcc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:33.988052 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3f38ee52-32af-4869-96f3-de5242efcc89 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:33.989260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f38ee52-32af-4869-96f3-de5242efcc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:34.107107 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 701/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:39:34.400034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6bdc0-ef4e-4189-896c-2f67c18a32d7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:34.401680 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f7b6bdc0-ef4e-4189-896c-2f67c18a32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:34.538374 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:34.588088 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6bdc0-ef4e-4189-896c-2f67c18a32d7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:34.745763 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7c71e-f20a-4ec5-b54e-ec4651e1cbba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:34.746264 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7c71e-f20a-4ec5-b54e-ec4651e1cbba service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:34.746544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7c71e-f20a-4ec5-b54e-ec4651e1cbba service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:34.746819 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7c71e-f20a-4ec5-b54e-ec4651e1cbba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:34.748588 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a3a7c71e-f20a-4ec5-b54e-ec4651e1cbba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:34.843955 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:34.863437 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7c71e-f20a-4ec5-b54e-ec4651e1cbba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:34.865858 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7c71e-f20a-4ec5-b54e-ec4651e1cbba service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:34.896448 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 675/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:37.521550 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d841-7a01-42a6-aa66-eaf40eb10ce9 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:37.522392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d841-7a01-42a6-aa66-eaf40eb10ce9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:37.522392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d841-7a01-42a6-aa66-eaf40eb10ce9 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:37.523766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 702/1377] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:37.530376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb566b-efca-437f-86d4-11c8a6f82da1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:37.531232 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb566b-efca-437f-86d4-11c8a6f82da1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:37.531232 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb566b-efca-437f-86d4-11c8a6f82da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:37.650721 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7ddb566b-efca-437f-86d4-11c8a6f82da1 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:37.652170 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7ddb566b-efca-437f-86d4-11c8a6f82da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:37.784714 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 676/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:39:38.230831 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d841-7a01-42a6-aa66-eaf40eb10ce9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:38.233899 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dee6d841-7a01-42a6-aa66-eaf40eb10ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:38.238952 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:38.410062 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d841-7a01-42a6-aa66-eaf40eb10ce9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:38.534864 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:38.601045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4754c-1a43-48b0-a797-6801cd41035f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:38.601933 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4754c-1a43-48b0-a797-6801cd41035f service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:38.602398 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4754c-1a43-48b0-a797-6801cd41035f service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:38.602827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4754c-1a43-48b0-a797-6801cd41035f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:38.604630 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-86a4754c-1a43-48b0-a797-6801cd41035f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:38.714596 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4754c-1a43-48b0-a797-6801cd41035f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:38.716445 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4754c-1a43-48b0-a797-6801cd41035f service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:38.738475 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 703/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:41.204427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c293e9-3a54-4ebb-906a-278458f16b1a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:41.205122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c293e9-3a54-4ebb-906a-278458f16b1a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:41.205122 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c293e9-3a54-4ebb-906a-278458f16b1a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:41.206457 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 677/1380] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:41.213734 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee799-4479-42f6-8835-b72b0395ed98 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:41.214288 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee799-4479-42f6-8835-b72b0395ed98 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:41.214386 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee799-4479-42f6-8835-b72b0395ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:41.296781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ac6ee799-4479-42f6-8835-b72b0395ed98 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:41.298880 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac6ee799-4479-42f6-8835-b72b0395ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:41.366786 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:41.438409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 704/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:41.734705 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c293e9-3a54-4ebb-906a-278458f16b1a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:41.737535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-78c293e9-3a54-4ebb-906a-278458f16b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:41.816976 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:41.953218 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c293e9-3a54-4ebb-906a-278458f16b1a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:42.124027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dd68b-c9f1-4a6d-a7ca-f6bc587f9faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:42.125059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dd68b-c9f1-4a6d-a7ca-f6bc587f9faf service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:42.125556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dd68b-c9f1-4a6d-a7ca-f6bc587f9faf service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:42.126051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dd68b-c9f1-4a6d-a7ca-f6bc587f9faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:42.129031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f10dd68b-c9f1-4a6d-a7ca-f6bc587f9faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:42.155983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:42.234763 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dd68b-c9f1-4a6d-a7ca-f6bc587f9faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:42.236310 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dd68b-c9f1-4a6d-a7ca-f6bc587f9faf service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:42.256874 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 678/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:44.592023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942206-3925-4b4f-a612-2ab22771faa6 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:44.593026 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942206-3925-4b4f-a612-2ab22771faa6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:44.593317 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942206-3925-4b4f-a612-2ab22771faa6 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:44.594897 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 705/1383] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:44.601981 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8e2bd-782c-40f5-9e56-065d5477fbff None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:44.602556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8e2bd-782c-40f5-9e56-065d5477fbff None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:44.602556 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8e2bd-782c-40f5-9e56-065d5477fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:44.683697 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7bd8e2bd-782c-40f5-9e56-065d5477fbff None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:44.684941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7bd8e2bd-782c-40f5-9e56-065d5477fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:44.833354 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:44.842683 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 679/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:45.394403 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942206-3925-4b4f-a612-2ab22771faa6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:45.396223 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c0942206-3925-4b4f-a612-2ab22771faa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:45.603732 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942206-3925-4b4f-a612-2ab22771faa6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:45.645403 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:45.808433 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d020ae-91f5-4142-b681-452cf2997c27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:45.809503 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d020ae-91f5-4142-b681-452cf2997c27 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:45.810541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d020ae-91f5-4142-b681-452cf2997c27 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:45.811144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d020ae-91f5-4142-b681-452cf2997c27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:45.814438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-66d020ae-91f5-4142-b681-452cf2997c27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:45.972785 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d020ae-91f5-4142-b681-452cf2997c27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:45.976089 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d020ae-91f5-4142-b681-452cf2997c27 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:46.001589 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 706/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 02:39:48.231975 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b451-5a3d-49bb-941c-346af8e50130 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:48.232761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b451-5a3d-49bb-941c-346af8e50130 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:48.232761 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b451-5a3d-49bb-941c-346af8e50130 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:48.234049 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 680/1386] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:48.240005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24f49-6ed3-4df5-a9a4-c93fe28fc34b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:48.240528 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24f49-6ed3-4df5-a9a4-c93fe28fc34b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:48.240645 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24f49-6ed3-4df5-a9a4-c93fe28fc34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:48.283906 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:48.319039 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6fb24f49-6ed3-4df5-a9a4-c93fe28fc34b None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:48.320260 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6fb24f49-6ed3-4df5-a9a4-c93fe28fc34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:48.444314 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 707/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:48.734344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b451-5a3d-49bb-941c-346af8e50130 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:48.735992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-92b2b451-5a3d-49bb-941c-346af8e50130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:48.847263 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32a3b6-b0e5-4ea1-b5e1-8f24f9f994c3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:48.847541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32a3b6-b0e5-4ea1-b5e1-8f24f9f994c3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:48.847810 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32a3b6-b0e5-4ea1-b5e1-8f24f9f994c3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:48.849159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 708/1388] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:39:48.854291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661fb8-7e03-4b55-9308-172025a88de2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:48.854574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661fb8-7e03-4b55-9308-172025a88de2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:48.854850 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661fb8-7e03-4b55-9308-172025a88de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:48.898283 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b451-5a3d-49bb-941c-346af8e50130 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:48.923420 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-67661fb8-7e03-4b55-9308-172025a88de2 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:48.924724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-67661fb8-7e03-4b55-9308-172025a88de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:48.971819 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:48.986447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:49.026852 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a1629-1108-42ab-8c10-1c5580d761be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:49.027501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a1629-1108-42ab-8c10-1c5580d761be service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:49.027804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a1629-1108-42ab-8c10-1c5580d761be service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:49.028267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a1629-1108-42ab-8c10-1c5580d761be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:49.030967 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-901a1629-1108-42ab-8c10-1c5580d761be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:49.031345 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 709/1389] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:39:49.132593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a1629-1108-42ab-8c10-1c5580d761be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:49.134444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a1629-1108-42ab-8c10-1c5580d761be service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:49.156472 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 681/1390] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:49.355111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24b81d-6c4a-4d53-b753-a9e75e67d7d2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:49.355740 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24b81d-6c4a-4d53-b753-a9e75e67d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:49.355916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24b81d-6c4a-4d53-b753-a9e75e67d7d2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:49.357385 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 710/1391] 10.222.0.57 () {54 vars in 962 bytes} [Thu Sep 22 02:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:49.363498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144159c9-7ecf-44bf-9156-2a8425000e97 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:49.364075 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144159c9-7ecf-44bf-9156-2a8425000e97 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:49.364277 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144159c9-7ecf-44bf-9156-2a8425000e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:49.461713 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-144159c9-7ecf-44bf-9156-2a8425000e97 None None] MFA Rules not processed for user `78a88b5980e5458198ad510ff8bf2994`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:49.462942 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-144159c9-7ecf-44bf-9156-2a8425000e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:49.485900 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:49.545835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 682/1392] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Sep 22 02:39:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:39:49.555708 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24b81d-6c4a-4d53-b753-a9e75e67d7d2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:49.557354 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8f24b81d-6c4a-4d53-b753-a9e75e67d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:49.672012 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24b81d-6c4a-4d53-b753-a9e75e67d7d2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:49.756968 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163b4b1-9075-4ca2-a7b5-f7aabb4a2ba0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78a88b5980e5458198ad510ff8bf2994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:49.757549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b4b1-9075-4ca2-a7b5-f7aabb4a2ba0 service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:49.757858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b4b1-9075-4ca2-a7b5-f7aabb4a2ba0 service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:49.758129 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b4b1-9075-4ca2-a7b5-f7aabb4a2ba0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:49.759808 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b163b4b1-9075-4ca2-a7b5-f7aabb4a2ba0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:49.778574 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:49.886818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163b4b1-9075-4ca2-a7b5-f7aabb4a2ba0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:49.888369 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163b4b1-9075-4ca2-a7b5-f7aabb4a2ba0 service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:49.907478 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 711/1393] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:50.696000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654c23-4f55-4e54-aa67-87c9b4f77533 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:50.696607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654c23-4f55-4e54-aa67-87c9b4f77533 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:50.696607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654c23-4f55-4e54-aa67-87c9b4f77533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:50.771787 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-cc654c23-4f55-4e54-aa67-87c9b4f77533 None None] MFA Rules not processed for user `6109aa049e0347bbae8c2e54235e66a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:50.773077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cc654c23-4f55-4e54-aa67-87c9b4f77533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:50.868892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 683/1394] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 22 02:39:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:50.920079 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c138-adff-40cc-8cdb-e9ad14ad721c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:50.920626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c138-adff-40cc-8cdb-e9ad14ad721c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:50.920626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c138-adff-40cc-8cdb-e9ad14ad721c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:50.921991 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 712/1395] 10.222.0.57 () {54 vars in 943 bytes} [Thu Sep 22 02:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:50.930378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bfe7a-ca5f-40b8-af60-b90f633a98df None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:50.931051 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bfe7a-ca5f-40b8-af60-b90f633a98df None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:50.931742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bfe7a-ca5f-40b8-af60-b90f633a98df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:50.985144 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:51.018880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1c6bfe7a-ca5f-40b8-af60-b90f633a98df None None] MFA Rules not processed for user `04490cc2eef14514bc2834de17458744`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:51.020205 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1c6bfe7a-ca5f-40b8-af60-b90f633a98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:51.140273 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 684/1396] 10.222.0.57 () {58 vars in 1040 bytes} [Thu Sep 22 02:39:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:51.149924 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c138-adff-40cc-8cdb-e9ad14ad721c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:51.151575 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-94e7c138-adff-40cc-8cdb-e9ad14ad721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:51.275010 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:51.303105 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c138-adff-40cc-8cdb-e9ad14ad721c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:51.433070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99c019-9d9f-49da-96e4-358ad6516bb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04490cc2eef14514bc2834de17458744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:51.433943 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99c019-9d9f-49da-96e4-358ad6516bb9 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:51.434249 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99c019-9d9f-49da-96e4-358ad6516bb9 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:51.434545 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99c019-9d9f-49da-96e4-358ad6516bb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:51.436983 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-de99c019-9d9f-49da-96e4-358ad6516bb9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:51.540163 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99c019-9d9f-49da-96e4-358ad6516bb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:51.541846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99c019-9d9f-49da-96e4-358ad6516bb9 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:51.553302 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 713/1397] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 22 02:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 02:39:52.089835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb181b-436d-4e0c-9784-1bc38f81374e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:52.089835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb181b-436d-4e0c-9784-1bc38f81374e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:52.089835 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb181b-436d-4e0c-9784-1bc38f81374e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:52.092156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 685/1398] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:52.098960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1965-906a-4f2f-b04a-4e279f6f21f8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:52.098960 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1965-906a-4f2f-b04a-4e279f6f21f8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:52.101823 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1965-906a-4f2f-b04a-4e279f6f21f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:52.118254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:52.180507 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-da6d1965-906a-4f2f-b04a-4e279f6f21f8 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:52.181844 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-da6d1965-906a-4f2f-b04a-4e279f6f21f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:52.309813 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 714/1399] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:52.596149 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb181b-436d-4e0c-9784-1bc38f81374e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:52.598429 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-acbb181b-436d-4e0c-9784-1bc38f81374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:52.736031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:52.806491 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb181b-436d-4e0c-9784-1bc38f81374e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:52.946290 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db235-38c0-4239-8cee-781c36a8e121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:52.946945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db235-38c0-4239-8cee-781c36a8e121 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:52.947230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db235-38c0-4239-8cee-781c36a8e121 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:52.947500 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db235-38c0-4239-8cee-781c36a8e121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:52.952590 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-786db235-38c0-4239-8cee-781c36a8e121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:53.023926 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:53.060795 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db235-38c0-4239-8cee-781c36a8e121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:53.062511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db235-38c0-4239-8cee-781c36a8e121 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:53.086525 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 686/1400] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:55.408829 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc74a9-b32b-449c-98e3-3985d27b2cca None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:55.409392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc74a9-b32b-449c-98e3-3985d27b2cca None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:55.409885 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc74a9-b32b-449c-98e3-3985d27b2cca None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:55.414085 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 715/1401] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:55.417872 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f230f68-a61a-4467-98b1-ac05edf018fc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:55.418515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f230f68-a61a-4467-98b1-ac05edf018fc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:55.418515 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f230f68-a61a-4467-98b1-ac05edf018fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:55.516923 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0f230f68-a61a-4467-98b1-ac05edf018fc None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:55.518378 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0f230f68-a61a-4467-98b1-ac05edf018fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:55.669892 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 687/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:55.983827 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc74a9-b32b-449c-98e3-3985d27b2cca None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:55.985186 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6bdc74a9-b32b-449c-98e3-3985d27b2cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:56.101609 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:56.179802 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc74a9-b32b-449c-98e3-3985d27b2cca None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:56.323848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a5f6e-25f1-4a85-b152-459ecfd837de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:56.324379 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5f6e-25f1-4a85-b152-459ecfd837de service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:56.324659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5f6e-25f1-4a85-b152-459ecfd837de service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:56.324935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5f6e-25f1-4a85-b152-459ecfd837de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:56.327714 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f48a5f6e-25f1-4a85-b152-459ecfd837de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:56.400594 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:56.440773 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a5f6e-25f1-4a85-b152-459ecfd837de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:56.442514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a5f6e-25f1-4a85-b152-459ecfd837de service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:56.464193 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 716/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:39:58.771200 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c76c-addd-4368-8a0d-48300b34a785 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:58.772073 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c76c-addd-4368-8a0d-48300b34a785 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:58.772652 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c76c-addd-4368-8a0d-48300b34a785 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:58.775760 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 688/1404] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:39:58.781590 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ff998-27eb-4507-aa48-6a8527865501 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:58.782296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ff998-27eb-4507-aa48-6a8527865501 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:58.782884 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ff998-27eb-4507-aa48-6a8527865501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:58.879862 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c04ff998-27eb-4507-aa48-6a8527865501 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:39:58.882637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c04ff998-27eb-4507-aa48-6a8527865501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:59.041297 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 717/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:39:59.353848 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c76c-addd-4368-8a0d-48300b34a785 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:39:59.355397 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7996c76c-addd-4368-8a0d-48300b34a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:59.413212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:59.593453 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c76c-addd-4368-8a0d-48300b34a785 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:39:59.760032 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:39:59.764510 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374994e-23af-4749-be9a-6557855583b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:39:59.766016 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374994e-23af-4749-be9a-6557855583b2 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:39:59.766534 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374994e-23af-4749-be9a-6557855583b2 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:39:59.767050 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374994e-23af-4749-be9a-6557855583b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:39:59.769024 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2374994e-23af-4749-be9a-6557855583b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:39:59.930124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374994e-23af-4749-be9a-6557855583b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:39:59.936124 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374994e-23af-4749-be9a-6557855583b2 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:39:59.970029 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 689/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:02.733584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227409-bec3-40cb-a981-de10ea5c4fd4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:02.734144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227409-bec3-40cb-a981-de10ea5c4fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:02.734144 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227409-bec3-40cb-a981-de10ea5c4fd4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:02.738023 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 718/1407] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:40:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:02.741733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1de8-844a-4c2b-bf32-7300ecc6b282 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:02.741733 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1de8-844a-4c2b-bf32-7300ecc6b282 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:02.742763 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1de8-844a-4c2b-bf32-7300ecc6b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:02.830245 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bb1e1de8-844a-4c2b-bf32-7300ecc6b282 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:02.831565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bb1e1de8-844a-4c2b-bf32-7300ecc6b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:02.932968 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:02.967085 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 690/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:40:03.281025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227409-bec3-40cb-a981-de10ea5c4fd4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:03.283027 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f8227409-bec3-40cb-a981-de10ea5c4fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:03.336327 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:03.488684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227409-bec3-40cb-a981-de10ea5c4fd4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:03.714450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:03.727253 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3678f2-c070-4a64-9060-3d66909d6a9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:03.728183 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3678f2-c070-4a64-9060-3d66909d6a9e service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:03.728654 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3678f2-c070-4a64-9060-3d66909d6a9e service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:03.729122 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3678f2-c070-4a64-9060-3d66909d6a9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:03.732029 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1d3678f2-c070-4a64-9060-3d66909d6a9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:03.913323 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3678f2-c070-4a64-9060-3d66909d6a9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:03.917360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3678f2-c070-4a64-9060-3d66909d6a9e service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:03.953973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 719/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:12.964616 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=11 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:13.941815 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=48 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:15.332740 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a173b-9f9d-4564-9d8d-b192bd22fcce None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:15.333314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a173b-9f9d-4564-9d8d-b192bd22fcce None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:15.333314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a173b-9f9d-4564-9d8d-b192bd22fcce None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:15.334731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 691/1410] 10.222.0.57 () {54 vars in 918 bytes} [Thu Sep 22 02:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:15.341281 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e10c-76de-482b-9203-84019ba39172 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:15.342025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e10c-76de-482b-9203-84019ba39172 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:15.342025 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669e10c-76de-482b-9203-84019ba39172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:15.421250 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d669e10c-76de-482b-9203-84019ba39172 None None] MFA Rules not processed for user `a8711bb78a6e4077aad9f5491c38173b`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:15.422500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d669e10c-76de-482b-9203-84019ba39172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:15.530793 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 720/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Sep 22 02:40:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:15.546256 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554611-d6ad-4122-88d5-3b34dcde3fc8 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:15.546535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554611-d6ad-4122-88d5-3b34dcde3fc8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:15.546805 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554611-d6ad-4122-88d5-3b34dcde3fc8 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:15.548518 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 692/1412] 10.222.0.57 () {54 vars in 918 bytes} [Thu Sep 22 02:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:15.554995 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c9eb0-d6df-409c-b2cb-58f5a27109c1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:15.555273 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c9eb0-d6df-409c-b2cb-58f5a27109c1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:15.555526 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c9eb0-d6df-409c-b2cb-58f5a27109c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:15.635360 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:15.639296 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-520c9eb0-d6df-409c-b2cb-58f5a27109c1 None None] MFA Rules not processed for user `94bfeac1fea64803913036131d3bc6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:15.641187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-520c9eb0-d6df-409c-b2cb-58f5a27109c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:15.760045 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 721/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Sep 22 02:40:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:18.393211 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b92b-6d59-4887-a7f7-7c99ab3804e9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:18.393771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b92b-6d59-4887-a7f7-7c99ab3804e9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:18.393771 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b92b-6d59-4887-a7f7-7c99ab3804e9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:18.395034 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:18.400583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651fa26-d162-4162-b45d-d2cfb5988283 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:18.401117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651fa26-d162-4162-b45d-d2cfb5988283 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:18.401117 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651fa26-d162-4162-b45d-d2cfb5988283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:18.468721 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1651fa26-d162-4162-b45d-d2cfb5988283 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:18.469986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1651fa26-d162-4162-b45d-d2cfb5988283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:18.524463 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:18.570057 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:18.872599 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68b92b-6d59-4887-a7f7-7c99ab3804e9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:18.874159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0d68b92b-6d59-4887-a7f7-7c99ab3804e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:19.020856 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68b92b-6d59-4887-a7f7-7c99ab3804e9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:19.094879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:19.135031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c402b49-2e30-4b21-8170-a8a8d2e38d16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:19.135550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c402b49-2e30-4b21-8170-a8a8d2e38d16 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:19.135828 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c402b49-2e30-4b21-8170-a8a8d2e38d16 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:19.136099 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c402b49-2e30-4b21-8170-a8a8d2e38d16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:19.138295 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7c402b49-2e30-4b21-8170-a8a8d2e38d16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:19.226031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c402b49-2e30-4b21-8170-a8a8d2e38d16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:19.227604 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c402b49-2e30-4b21-8170-a8a8d2e38d16 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:19.247161 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 694/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:20.405973 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74f08-b97d-4c65-b2ab-af5a7dcd298f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:20.406543 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74f08-b97d-4c65-b2ab-af5a7dcd298f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:20.406543 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74f08-b97d-4c65-b2ab-af5a7dcd298f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:20.407858 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:20.414327 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a001a-c4bb-432e-956c-5099eea26bde None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:20.414777 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a001a-c4bb-432e-956c-5099eea26bde None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:20.414884 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a001a-c4bb-432e-956c-5099eea26bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:20.491156 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-034a001a-c4bb-432e-956c-5099eea26bde None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:20.492372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-034a001a-c4bb-432e-956c-5099eea26bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:20.522165 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:20.603632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:20.765344 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf74f08-b97d-4c65-b2ab-af5a7dcd298f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:20.766926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-faf74f08-b97d-4c65-b2ab-af5a7dcd298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:20.915001 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf74f08-b97d-4c65-b2ab-af5a7dcd298f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:20.955187 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:21.029988 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5608fc-d89b-4805-ba09-18b6046e0c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:21.030649 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5608fc-d89b-4805-ba09-18b6046e0c4f service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:21.030874 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5608fc-d89b-4805-ba09-18b6046e0c4f service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:21.031139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5608fc-d89b-4805-ba09-18b6046e0c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:21.032780 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7e5608fc-d89b-4805-ba09-18b6046e0c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:21.123921 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5608fc-d89b-4805-ba09-18b6046e0c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:21.125521 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5608fc-d89b-4805-ba09-18b6046e0c4f service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:21.144205 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 724/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:22.307079 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8086-2e56-4e30-8c8e-3060b51fcc97 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:22.307638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8086-2e56-4e30-8c8e-3060b51fcc97 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:22.307638 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8086-2e56-4e30-8c8e-3060b51fcc97 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:22.309869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:22.316846 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5a26-9015-45e0-9d68-4a30b811cfb4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:22.317429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5a26-9015-45e0-9d68-4a30b811cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:22.317429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5a26-9015-45e0-9d68-4a30b811cfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:22.377141 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:22.401687 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-396b5a26-9015-45e0-9d68-4a30b811cfb4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:22.402977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-396b5a26-9015-45e0-9d68-4a30b811cfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:22.507518 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:22.659880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8086-2e56-4e30-8c8e-3060b51fcc97 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:22.661479 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-755a8086-2e56-4e30-8c8e-3060b51fcc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:22.810829 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8086-2e56-4e30-8c8e-3060b51fcc97 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:22.823046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:22.926527 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce63a0-f1b1-4f8b-9026-0852ef06070f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:22.927031 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce63a0-f1b1-4f8b-9026-0852ef06070f service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:22.927305 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce63a0-f1b1-4f8b-9026-0852ef06070f service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:22.927573 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce63a0-f1b1-4f8b-9026-0852ef06070f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:22.929190 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-25ce63a0-f1b1-4f8b-9026-0852ef06070f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:23.020991 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce63a0-f1b1-4f8b-9026-0852ef06070f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:23.022615 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce63a0-f1b1-4f8b-9026-0852ef06070f service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:23.041444 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 697/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:24.159741 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde01ac-7974-4c6d-97b0-10f085d7ec67 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:24.160349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde01ac-7974-4c6d-97b0-10f085d7ec67 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:24.160349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde01ac-7974-4c6d-97b0-10f085d7ec67 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:24.161615 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:24.168544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef1aa-ffec-4f9d-94b7-02b611056dc8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:24.169321 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef1aa-ffec-4f9d-94b7-02b611056dc8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:24.169427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef1aa-ffec-4f9d-94b7-02b611056dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:24.188754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:24.245320 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9a6ef1aa-ffec-4f9d-94b7-02b611056dc8 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:24.246602 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9a6ef1aa-ffec-4f9d-94b7-02b611056dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:24.342759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:24.497890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde01ac-7974-4c6d-97b0-10f085d7ec67 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:24.499435 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3cde01ac-7974-4c6d-97b0-10f085d7ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:24.619689 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:24.666842 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde01ac-7974-4c6d-97b0-10f085d7ec67 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:24.784595 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499183-dd72-4de3-a90f-d82bf928cf8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:24.785114 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499183-dd72-4de3-a90f-d82bf928cf8a service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:24.785392 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499183-dd72-4de3-a90f-d82bf928cf8a service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:24.785684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499183-dd72-4de3-a90f-d82bf928cf8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:24.787290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-13499183-dd72-4de3-a90f-d82bf928cf8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:24.864939 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:24.879290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499183-dd72-4de3-a90f-d82bf928cf8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:24.880894 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499183-dd72-4de3-a90f-d82bf928cf8a service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:24.899005 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 727/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:26.049303 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7b0b-05ef-445a-81d6-e6bd91fa16cc None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:26.049944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7b0b-05ef-445a-81d6-e6bd91fa16cc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:26.049944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7b0b-05ef-445a-81d6-e6bd91fa16cc None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:26.051241 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:26.057795 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc7eae-2c06-4319-b58a-a5d33dc369c3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:26.058315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc7eae-2c06-4319-b58a-a5d33dc369c3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:26.058430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc7eae-2c06-4319-b58a-a5d33dc369c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:26.138436 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-aebc7eae-2c06-4319-b58a-a5d33dc369c3 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:26.139660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-aebc7eae-2c06-4319-b58a-a5d33dc369c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:26.238223 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:26.389023 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c7b0b-05ef-445a-81d6-e6bd91fa16cc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:26.390511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-517c7b0b-05ef-445a-81d6-e6bd91fa16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:26.482983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:26.548535 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c7b0b-05ef-445a-81d6-e6bd91fa16cc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:26.675189 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649685ee-f626-4ac8-813c-741011a4c6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:26.675702 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649685ee-f626-4ac8-813c-741011a4c6b1 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:26.675991 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649685ee-f626-4ac8-813c-741011a4c6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:26.676257 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649685ee-f626-4ac8-813c-741011a4c6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:26.677930 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-649685ee-f626-4ac8-813c-741011a4c6b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:26.730719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:26.772478 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649685ee-f626-4ac8-813c-741011a4c6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:26.774111 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649685ee-f626-4ac8-813c-741011a4c6b1 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:26.792095 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 700/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:27.864530 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421f39-f8f5-4227-b90f-47c26efdc875 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:27.865108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421f39-f8f5-4227-b90f-47c26efdc875 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:27.865108 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421f39-f8f5-4227-b90f-47c26efdc875 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:27.866438 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:27.873501 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442976b0-2820-43a9-a6df-59653de47858 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:27.874063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442976b0-2820-43a9-a6df-59653de47858 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:27.874063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442976b0-2820-43a9-a6df-59653de47858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:27.955860 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-442976b0-2820-43a9-a6df-59653de47858 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:27.957057 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-442976b0-2820-43a9-a6df-59653de47858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:28.054833 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:28.207676 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34421f39-f8f5-4227-b90f-47c26efdc875 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:28.209194 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-34421f39-f8f5-4227-b90f-47c26efdc875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:28.256744 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:28.356819 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34421f39-f8f5-4227-b90f-47c26efdc875 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:28.496619 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c5342-654f-4144-ac9e-b335b3e95d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:28.497234 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5342-654f-4144-ac9e-b335b3e95d65 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:28.497568 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5342-654f-4144-ac9e-b335b3e95d65 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:28.497790 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5342-654f-4144-ac9e-b335b3e95d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:28.499419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d09c5342-654f-4144-ac9e-b335b3e95d65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:28.506660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:28.592990 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c5342-654f-4144-ac9e-b335b3e95d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:28.594660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c5342-654f-4144-ac9e-b335b3e95d65 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:28.613563 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 730/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:29.686743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955152-5a68-4348-b38d-d73e13a8ced0 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:29.687315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955152-5a68-4348-b38d-d73e13a8ced0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:29.687315 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955152-5a68-4348-b38d-d73e13a8ced0 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:29.688695 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:29.695776 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fc0d3-3b9e-49b1-89d6-c278cf28d99a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:29.696315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fc0d3-3b9e-49b1-89d6-c278cf28d99a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:29.696315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fc0d3-3b9e-49b1-89d6-c278cf28d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:29.771801 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a37fc0d3-3b9e-49b1-89d6-c278cf28d99a None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:29.773039 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a37fc0d3-3b9e-49b1-89d6-c278cf28d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:29.842869 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:29.873100 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:30.021985 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955152-5a68-4348-b38d-d73e13a8ced0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:30.023557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-30955152-5a68-4348-b38d-d73e13a8ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:30.043318 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:30.175778 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955152-5a68-4348-b38d-d73e13a8ced0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:30.265006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:30.291312 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c732e-8fcc-4a55-a4e4-afe9bc39a4c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:30.291918 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c732e-8fcc-4a55-a4e4-afe9bc39a4c6 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:30.292195 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c732e-8fcc-4a55-a4e4-afe9bc39a4c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:30.292469 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c732e-8fcc-4a55-a4e4-afe9bc39a4c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:30.294414 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c01c732e-8fcc-4a55-a4e4-afe9bc39a4c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:30.388651 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c732e-8fcc-4a55-a4e4-afe9bc39a4c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:30.390293 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c732e-8fcc-4a55-a4e4-afe9bc39a4c6 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:30.409864 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 703/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:31.518894 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ea30-aabc-47bf-b677-3b5669edeeed None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:31.519450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ea30-aabc-47bf-b677-3b5669edeeed None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:31.519450 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ea30-aabc-47bf-b677-3b5669edeeed None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:31.520830 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:31.527636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35e8a-e351-495e-b150-54d1c0f91d9e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:31.528112 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35e8a-e351-495e-b150-54d1c0f91d9e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:31.528225 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35e8a-e351-495e-b150-54d1c0f91d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:31.605865 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2dd35e8a-e351-495e-b150-54d1c0f91d9e None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:31.607098 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2dd35e8a-e351-495e-b150-54d1c0f91d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:31.649754 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:31.706474 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:31.858278 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907ea30-aabc-47bf-b677-3b5669edeeed None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:31.859722 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3907ea30-aabc-47bf-b677-3b5669edeeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:32.009514 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907ea30-aabc-47bf-b677-3b5669edeeed None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:32.067738 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:32.129102 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f70681-3316-4e96-976d-67bf50d37bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:32.129626 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f70681-3316-4e96-976d-67bf50d37bf2 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:32.129945 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f70681-3316-4e96-976d-67bf50d37bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:32.130217 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f70681-3316-4e96-976d-67bf50d37bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:32.131875 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-07f70681-3316-4e96-976d-67bf50d37bf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:32.224071 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f70681-3316-4e96-976d-67bf50d37bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:32.225734 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f70681-3316-4e96-976d-67bf50d37bf2 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:32.245252 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 733/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:33.359355 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e57e7-76b1-4b6c-b853-0da7944c4baa None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:33.359914 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e57e7-76b1-4b6c-b853-0da7944c4baa None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:33.360110 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e57e7-76b1-4b6c-b853-0da7944c4baa None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:33.361485 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 02:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:33.368361 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49d3e-0059-4b97-a94a-a2e717b79770 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:33.368900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49d3e-0059-4b97-a94a-a2e717b79770 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:33.368900 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49d3e-0059-4b97-a94a-a2e717b79770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:33.447101 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7bb49d3e-0059-4b97-a94a-a2e717b79770 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:33.448322 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7bb49d3e-0059-4b97-a94a-a2e717b79770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:33.450408 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:33.545738 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 02:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:33.697882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e57e7-76b1-4b6c-b853-0da7944c4baa None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:33.699457 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bd5e57e7-76b1-4b6c-b853-0da7944c4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:33.845796 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e57e7-76b1-4b6c-b853-0da7944c4baa None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:33.873551 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:33.961950 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dbf4-ea7e-4aea-9e60-349672a265c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:33.962564 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dbf4-ea7e-4aea-9e60-349672a265c7 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:33.962868 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dbf4-ea7e-4aea-9e60-349672a265c7 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:33.963109 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dbf4-ea7e-4aea-9e60-349672a265c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:33.965368 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-dd45dbf4-ea7e-4aea-9e60-349672a265c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:34.057576 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dbf4-ea7e-4aea-9e60-349672a265c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:34.059390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dbf4-ea7e-4aea-9e60-349672a265c7 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:34.077944 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 706/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:36.170864 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f2d1b-5b51-4059-9996-b9c9e5a0274c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:36.171437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f2d1b-5b51-4059-9996-b9c9e5a0274c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:36.171437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f2d1b-5b51-4059-9996-b9c9e5a0274c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:36.172766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:36.178186 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5f2b-76b0-4857-8bd9-b1e1408502d4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:36.178658 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5f2b-76b0-4857-8bd9-b1e1408502d4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:36.178785 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5f2b-76b0-4857-8bd9-b1e1408502d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:36.220262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:36.247848 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9d4e5f2b-76b0-4857-8bd9-b1e1408502d4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:36.249060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9d4e5f2b-76b0-4857-8bd9-b1e1408502d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:36.358255 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:36.642954 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f2d1b-5b51-4059-9996-b9c9e5a0274c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:36.644538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a48f2d1b-5b51-4059-9996-b9c9e5a0274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:36.764772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f2d1b-5b51-4059-9996-b9c9e5a0274c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:36.797300 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:36.842150 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fed49-6731-43e1-ab2a-e03a914ca95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:36.842914 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fed49-6731-43e1-ab2a-e03a914ca95d service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:36.843060 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fed49-6731-43e1-ab2a-e03a914ca95d service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:36.843287 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fed49-6731-43e1-ab2a-e03a914ca95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:36.844881 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a54fed49-6731-43e1-ab2a-e03a914ca95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:36.954640 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fed49-6731-43e1-ab2a-e03a914ca95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:36.956059 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fed49-6731-43e1-ab2a-e03a914ca95d service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:36.973504 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 736/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 02:40:39.410332 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b2892-8a1b-4125-bdb4-e0fda900582d None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:39.410880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b2892-8a1b-4125-bdb4-e0fda900582d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:39.410880 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b2892-8a1b-4125-bdb4-e0fda900582d None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:39.412229 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:39.418818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c06b-37ec-46ff-98fe-0fb649b62af8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:39.419576 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c06b-37ec-46ff-98fe-0fb649b62af8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:39.419684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c06b-37ec-46ff-98fe-0fb649b62af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:39.486322 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-daf7c06b-37ec-46ff-98fe-0fb649b62af8 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:39.487556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-daf7c06b-37ec-46ff-98fe-0fb649b62af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:39.501479 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:39.589950 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:39.871471 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b2892-8a1b-4125-bdb4-e0fda900582d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:39.873087 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6d7b2892-8a1b-4125-bdb4-e0fda900582d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:39.979365 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b2892-8a1b-4125-bdb4-e0fda900582d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:39.993460 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:40.058646 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308aed-cd2c-4821-a0b8-566acd94e5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:40.059252 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308aed-cd2c-4821-a0b8-566acd94e5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:40.059528 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308aed-cd2c-4821-a0b8-566acd94e5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:40.059799 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308aed-cd2c-4821-a0b8-566acd94e5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:40.061421 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c3308aed-cd2c-4821-a0b8-566acd94e5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:40.174182 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3308aed-cd2c-4821-a0b8-566acd94e5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:40.175525 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3308aed-cd2c-4821-a0b8-566acd94e5c7 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:40.193913 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 709/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:42.720634 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c9c3-73c7-4ee6-876b-03d78bebda18 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:42.721201 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c9c3-73c7-4ee6-876b-03d78bebda18 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:42.721201 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c9c3-73c7-4ee6-876b-03d78bebda18 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:42.722559 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:42.728043 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7954b-4632-4da3-8c8d-0a8f74a01141 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:42.728475 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7954b-4632-4da3-8c8d-0a8f74a01141 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:42.728581 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7954b-4632-4da3-8c8d-0a8f74a01141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:42.777731 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:42.796565 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-5dd7954b-4632-4da3-8c8d-0a8f74a01141 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:42.797811 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5dd7954b-4632-4da3-8c8d-0a8f74a01141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:42.896563 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:40:43.176955 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c9c3-73c7-4ee6-876b-03d78bebda18 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:43.178544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-56a1c9c3-73c7-4ee6-876b-03d78bebda18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:43.283104 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c9c3-73c7-4ee6-876b-03d78bebda18 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:43.325333 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:43.360726 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540f031-fe45-4313-a9d4-55a6a15ea314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:43.361334 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f031-fe45-4313-a9d4-55a6a15ea314 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:43.361610 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f031-fe45-4313-a9d4-55a6a15ea314 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:43.361918 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f031-fe45-4313-a9d4-55a6a15ea314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:43.363586 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d540f031-fe45-4313-a9d4-55a6a15ea314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:43.489423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540f031-fe45-4313-a9d4-55a6a15ea314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:43.490910 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540f031-fe45-4313-a9d4-55a6a15ea314 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:43.512065 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 739/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:45.850529 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089ab1-e900-4e59-a253-1a11739606ef None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:45.851117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089ab1-e900-4e59-a253-1a11739606ef None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:45.851117 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089ab1-e900-4e59-a253-1a11739606ef None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:45.852419 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:45.857735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f6d1-1758-43ef-833f-1c2dbce32287 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:45.858159 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f6d1-1758-43ef-833f-1c2dbce32287 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:45.858315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f6d1-1758-43ef-833f-1c2dbce32287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:45.924547 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0046f6d1-1758-43ef-833f-1c2dbce32287 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:45.926081 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0046f6d1-1758-43ef-833f-1c2dbce32287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:45.947539 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:46.024866 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:46.308939 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089ab1-e900-4e59-a253-1a11739606ef None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:46.310557 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ab089ab1-e900-4e59-a253-1a11739606ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:46.421110 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089ab1-e900-4e59-a253-1a11739606ef None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:46.442953 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:46.517376 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4361-164f-48f8-952e-71f1982e5592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:46.518022 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4361-164f-48f8-952e-71f1982e5592 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:46.518307 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4361-164f-48f8-952e-71f1982e5592 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:46.518582 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4361-164f-48f8-952e-71f1982e5592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:46.520231 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-98ea4361-164f-48f8-952e-71f1982e5592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:46.635552 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4361-164f-48f8-952e-71f1982e5592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:46.637029 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4361-164f-48f8-952e-71f1982e5592 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:46.657434 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 712/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:48.970769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f266934-4cf6-4e5f-8da7-eef66810de19 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:48.971430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f266934-4cf6-4e5f-8da7-eef66810de19 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:48.971430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f266934-4cf6-4e5f-8da7-eef66810de19 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:48.972660 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:48.978344 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c6efe-0eda-40ba-81b6-1084135d9888 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:48.978802 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c6efe-0eda-40ba-81b6-1084135d9888 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:48.978896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c6efe-0eda-40ba-81b6-1084135d9888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:49.045973 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:49.049129 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-128c6efe-0eda-40ba-81b6-1084135d9888 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:49.051002 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-128c6efe-0eda-40ba-81b6-1084135d9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:49.149669 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:49.432964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f266934-4cf6-4e5f-8da7-eef66810de19 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:49.434578 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4f266934-4cf6-4e5f-8da7-eef66810de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:49.546800 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f266934-4cf6-4e5f-8da7-eef66810de19 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:49.597965 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:49.623682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fd2f1-2ba5-481d-9c1a-db402c09d425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:49.624290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd2f1-2ba5-481d-9c1a-db402c09d425 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:49.624628 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd2f1-2ba5-481d-9c1a-db402c09d425 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:49.624832 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd2f1-2ba5-481d-9c1a-db402c09d425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:49.626495 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2b5fd2f1-2ba5-481d-9c1a-db402c09d425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:49.740283 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fd2f1-2ba5-481d-9c1a-db402c09d425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:49.741742 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fd2f1-2ba5-481d-9c1a-db402c09d425 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:49.760167 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 742/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:52.017462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adaac3-f564-4767-a959-15ad9c09659c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:52.018130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adaac3-f564-4767-a959-15ad9c09659c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:52.018130 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adaac3-f564-4767-a959-15ad9c09659c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:52.019570 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:52.025095 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578444dc-5019-41a8-956b-a8b8e7271d27 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:52.025560 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578444dc-5019-41a8-956b-a8b8e7271d27 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:52.025694 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578444dc-5019-41a8-956b-a8b8e7271d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:52.095890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-578444dc-5019-41a8-956b-a8b8e7271d27 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:52.097106 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-578444dc-5019-41a8-956b-a8b8e7271d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:52.126132 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:52.200349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:52.486293 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adaac3-f564-4767-a959-15ad9c09659c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:52.487832 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-25adaac3-f564-4767-a959-15ad9c09659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:52.595125 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adaac3-f564-4767-a959-15ad9c09659c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:52.624924 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:52.672239 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0707b86-1a02-406a-aafd-0c61ec71ea33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:52.672841 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0707b86-1a02-406a-aafd-0c61ec71ea33 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:52.673121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0707b86-1a02-406a-aafd-0c61ec71ea33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:52.673390 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0707b86-1a02-406a-aafd-0c61ec71ea33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:52.675158 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b0707b86-1a02-406a-aafd-0c61ec71ea33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:52.788511 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0707b86-1a02-406a-aafd-0c61ec71ea33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:52.789867 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0707b86-1a02-406a-aafd-0c61ec71ea33 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:52.809010 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 715/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:55.063661 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f4fe-d126-436e-ab76-1f31d1ece43e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:55.064282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f4fe-d126-436e-ab76-1f31d1ece43e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:55.064282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f4fe-d126-436e-ab76-1f31d1ece43e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:55.065549 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:55.071092 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b826b-ffe8-4c5e-b46c-6e48304baee6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:55.071550 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b826b-ffe8-4c5e-b46c-6e48304baee6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:55.071660 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b826b-ffe8-4c5e-b46c-6e48304baee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:55.137790 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e41b826b-ffe8-4c5e-b46c-6e48304baee6 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:55.139000 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e41b826b-ffe8-4c5e-b46c-6e48304baee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:55.147324 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:55.239759 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:40:55.524301 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f4fe-d126-436e-ab76-1f31d1ece43e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:55.526391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d2b3f4fe-d126-436e-ab76-1f31d1ece43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:55.636214 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f4fe-d126-436e-ab76-1f31d1ece43e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:55.693318 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:55.711484 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ca59e-b1ea-4873-9d31-f58ca8ab4ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:55.712090 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ca59e-b1ea-4873-9d31-f58ca8ab4ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:55.712368 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ca59e-b1ea-4873-9d31-f58ca8ab4ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:55.712641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ca59e-b1ea-4873-9d31-f58ca8ab4ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:55.714769 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e74ca59e-b1ea-4873-9d31-f58ca8ab4ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:55.823579 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ca59e-b1ea-4873-9d31-f58ca8ab4ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:55.824929 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ca59e-b1ea-4873-9d31-f58ca8ab4ad9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:55.844770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 745/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:40:58.106734 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b197e2-445a-4e9d-ae47-339ef42b048b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:58.107303 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b197e2-445a-4e9d-ae47-339ef42b048b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:58.107303 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b197e2-445a-4e9d-ae47-339ef42b048b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:58.108632 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:40:58.114335 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374dc-7c8c-435c-b2d6-65dc64060092 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:58.114787 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374dc-7c8c-435c-b2d6-65dc64060092 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:58.114902 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374dc-7c8c-435c-b2d6-65dc64060092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:58.191099 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0d7374dc-7c8c-435c-b2d6-65dc64060092 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:40:58.192328 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0d7374dc-7c8c-435c-b2d6-65dc64060092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:58.231254 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:58.290391 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 02:40:58.573628 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b197e2-445a-4e9d-ae47-339ef42b048b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:40:58.575302 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-94b197e2-445a-4e9d-ae47-339ef42b048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:58.688267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b197e2-445a-4e9d-ae47-339ef42b048b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:40:58.727941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:40:58.765866 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab3716-d737-45d9-96df-342fcf4a2f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:40:58.766367 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab3716-d737-45d9-96df-342fcf4a2f28 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:40:58.766647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab3716-d737-45d9-96df-342fcf4a2f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:40:58.766917 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab3716-d737-45d9-96df-342fcf4a2f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:40:58.768529 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4fab3716-d737-45d9-96df-342fcf4a2f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:40:58.877757 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab3716-d737-45d9-96df-342fcf4a2f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:40:58.879190 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab3716-d737-45d9-96df-342fcf4a2f28 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:40:58.897242 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 718/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:01.100867 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb00bf-7aef-4004-b9c8-ad0507c4df0e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:01.101447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb00bf-7aef-4004-b9c8-ad0507c4df0e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:01.101447 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb00bf-7aef-4004-b9c8-ad0507c4df0e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:01.102904 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:01.109605 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3df801-87af-49bd-ba47-7092bb8ed773 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:01.110101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3df801-87af-49bd-ba47-7092bb8ed773 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:01.110230 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3df801-87af-49bd-ba47-7092bb8ed773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:01.298870 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ad3df801-87af-49bd-ba47-7092bb8ed773 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:01.300104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ad3df801-87af-49bd-ba47-7092bb8ed773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:01.319890 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:01.399592 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:01.687419 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb00bf-7aef-4004-b9c8-ad0507c4df0e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:01.688956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e7bb00bf-7aef-4004-b9c8-ad0507c4df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:01.795763 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb00bf-7aef-4004-b9c8-ad0507c4df0e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:01.989818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:01.999666 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead39655-6e06-4b0a-81a2-21f413725f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:02.000277 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead39655-6e06-4b0a-81a2-21f413725f9b service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:02.000556 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead39655-6e06-4b0a-81a2-21f413725f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:02.000820 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead39655-6e06-4b0a-81a2-21f413725f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:02.002465 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ead39655-6e06-4b0a-81a2-21f413725f9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:02.116735 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead39655-6e06-4b0a-81a2-21f413725f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:02.118199 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead39655-6e06-4b0a-81a2-21f413725f9b service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:02.136779 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 748/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:04.366254 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ae08-08db-48b0-89d3-f9f92e8954d3 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:04.366825 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ae08-08db-48b0-89d3-f9f92e8954d3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:04.366825 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ae08-08db-48b0-89d3-f9f92e8954d3 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:04.368135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 02:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:04.374123 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7443-562f-4890-a0b4-d888f310ae7a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:04.374572 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7443-562f-4890-a0b4-d888f310ae7a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:04.374682 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7443-562f-4890-a0b4-d888f310ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:04.440633 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ee2d7443-562f-4890-a0b4-d888f310ae7a None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:04.441870 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ee2d7443-562f-4890-a0b4-d888f310ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:04.489718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:04.538672 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:04.822636 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ae08-08db-48b0-89d3-f9f92e8954d3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:04.824226 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-63b4ae08-08db-48b0-89d3-f9f92e8954d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:04.932188 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ae08-08db-48b0-89d3-f9f92e8954d3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:04.980742 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:05.006982 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f42411-6bb8-4efc-ad7a-7e1b5b658f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:05.007595 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f42411-6bb8-4efc-ad7a-7e1b5b658f16 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:05.007876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f42411-6bb8-4efc-ad7a-7e1b5b658f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:05.008180 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f42411-6bb8-4efc-ad7a-7e1b5b658f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:05.009844 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-15f42411-6bb8-4efc-ad7a-7e1b5b658f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:05.124027 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f42411-6bb8-4efc-ad7a-7e1b5b658f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:05.125457 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f42411-6bb8-4efc-ad7a-7e1b5b658f16 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:05.143896 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 721/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:14.537069 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=22 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:15.141637 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=66 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:25.399040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae656-3a68-4281-839d-f83d3fc762b2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:25.399652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae656-3a68-4281-839d-f83d3fc762b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:25.399652 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae656-3a68-4281-839d-f83d3fc762b2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:25.401462 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 750/1471] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:25.406827 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf230e-2e19-43e8-ad4d-037f26cab0a7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:25.407279 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf230e-2e19-43e8-ad4d-037f26cab0a7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:25.407400 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf230e-2e19-43e8-ad4d-037f26cab0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:25.473158 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d2cf230e-2e19-43e8-ad4d-037f26cab0a7 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:25.474395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d2cf230e-2e19-43e8-ad4d-037f26cab0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:25.574078 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 722/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:25.875070 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba2d8-7a77-49c1-bd28-2e59b7eb0534 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:25.875349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba2d8-7a77-49c1-bd28-2e59b7eb0534 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:25.875625 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba2d8-7a77-49c1-bd28-2e59b7eb0534 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:25.876956 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 751/1473] 10.222.0.57 () {54 vars in 962 bytes} [Thu Sep 22 02:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 02:41:25.882882 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45416d-f67f-4060-94c1-b2b1b0462074 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:25.883289 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45416d-f67f-4060-94c1-b2b1b0462074 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:25.883432 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45416d-f67f-4060-94c1-b2b1b0462074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:25.960818 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-5e45416d-f67f-4060-94c1-b2b1b0462074 None None] MFA Rules not processed for user `78a88b5980e5458198ad510ff8bf2994`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:25.962063 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5e45416d-f67f-4060-94c1-b2b1b0462074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:25.983715 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:26.040006 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 723/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Sep 22 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:26.048781 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba2d8-7a77-49c1-bd28-2e59b7eb0534 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:26.050359 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e8fba2d8-7a77-49c1-bd28-2e59b7eb0534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:26.153487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba2d8-7a77-49c1-bd28-2e59b7eb0534 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:26.227644 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490251a-8a4c-40d5-a412-23bb9dd15d89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78a88b5980e5458198ad510ff8bf2994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:26.228770 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490251a-8a4c-40d5-a412-23bb9dd15d89 service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:26.229046 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490251a-8a4c-40d5-a412-23bb9dd15d89 service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:26.229315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490251a-8a4c-40d5-a412-23bb9dd15d89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:26.230958 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6490251a-8a4c-40d5-a412-23bb9dd15d89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:26.284591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:26.342861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490251a-8a4c-40d5-a412-23bb9dd15d89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:26.344284 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490251a-8a4c-40d5-a412-23bb9dd15d89 service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:26.362861 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 752/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:28.615494 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a249-82dc-4400-8731-933900fc419e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:28.616058 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a249-82dc-4400-8731-933900fc419e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:28.616058 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a249-82dc-4400-8731-933900fc419e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:28.617385 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 724/1476] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:28.623347 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96cd40-8f10-4d4c-8b70-d72bdf8ffa09 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:28.623913 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96cd40-8f10-4d4c-8b70-d72bdf8ffa09 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:28.623913 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96cd40-8f10-4d4c-8b70-d72bdf8ffa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:28.692349 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7c96cd40-8f10-4d4c-8b70-d72bdf8ffa09 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:28.693570 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7c96cd40-8f10-4d4c-8b70-d72bdf8ffa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:28.788718 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 753/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:29.066583 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07a249-82dc-4400-8731-933900fc419e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:29.068046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8e07a249-82dc-4400-8731-933900fc419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:29.193941 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07a249-82dc-4400-8731-933900fc419e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:29.246466 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:29.295694 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6b55a-7415-4c17-b44f-bbc5f8c1f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:29.296301 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6b55a-7415-4c17-b44f-bbc5f8c1f84b admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:29.296578 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6b55a-7415-4c17-b44f-bbc5f8c1f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:29.296848 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6b55a-7415-4c17-b44f-bbc5f8c1f84b admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:29.297507 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6b55a-7415-4c17-b44f-bbc5f8c1f84b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:29.299287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-8ef6b55a-7415-4c17-b44f-bbc5f8c1f84b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:41:29.299287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 22 02:41:29.299287 dv-cinder-857075-7-smb devstack@keystone.service[88076]: Sep 22 02:41:29.300418 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6b55a-7415-4c17-b44f-bbc5f8c1f84b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:29.319464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 725/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 22 02:41:29 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:41:31.526904 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21edf-e09a-4e01-978d-7b2361ab472b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:31.527562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21edf-e09a-4e01-978d-7b2361ab472b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:31.527562 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21edf-e09a-4e01-978d-7b2361ab472b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:31.528844 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 754/1479] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:31.537078 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a849b8-19aa-412a-8837-2499b1ef62c8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:31.537593 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a849b8-19aa-412a-8837-2499b1ef62c8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:31.537703 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a849b8-19aa-412a-8837-2499b1ef62c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:31.608101 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-70a849b8-19aa-412a-8837-2499b1ef62c8 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:31.609314 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-70a849b8-19aa-412a-8837-2499b1ef62c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:31.705574 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 726/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:32.000290 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21edf-e09a-4e01-978d-7b2361ab472b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:32.002048 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9af21edf-e09a-4e01-978d-7b2361ab472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:32.012474 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:32.155624 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21edf-e09a-4e01-978d-7b2361ab472b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:32.234246 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:32.266916 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec3d4-3e08-4f3d-84e9-d2a623346921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bfeac1fea64803913036131d3bc6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:32.267441 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec3d4-3e08-4f3d-84e9-d2a623346921 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:32.267716 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec3d4-3e08-4f3d-84e9-d2a623346921 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:32.267987 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec3d4-3e08-4f3d-84e9-d2a623346921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:32.269583 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5cfec3d4-3e08-4f3d-84e9-d2a623346921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:32.356437 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec3d4-3e08-4f3d-84e9-d2a623346921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:32.358054 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec3d4-3e08-4f3d-84e9-d2a623346921 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:32.375984 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 755/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:34.778906 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9951-7ed1-4564-ad19-8d87d97bb8ee None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:34.779462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9951-7ed1-4564-ad19-8d87d97bb8ee None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:34.779462 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9951-7ed1-4564-ad19-8d87d97bb8ee None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:34.780719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 727/1482] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:34.786315 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9e67-bb1f-410d-bec7-ef706a9f4e0e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:34.786766 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9e67-bb1f-410d-bec7-ef706a9f4e0e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:34.786901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9e67-bb1f-410d-bec7-ef706a9f4e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:34.852750 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-84fd9e67-bb1f-410d-bec7-ef706a9f4e0e None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:34.854024 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-84fd9e67-bb1f-410d-bec7-ef706a9f4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:34.903196 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:34.961116 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 756/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:35.256116 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9951-7ed1-4564-ad19-8d87d97bb8ee None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:35.257727 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-77ab9951-7ed1-4564-ad19-8d87d97bb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:35.283395 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:35.369744 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9951-7ed1-4564-ad19-8d87d97bb8ee None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:35.445433 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e55c4-2df2-4a01-9d6c-6a3ae6952766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:35.446066 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e55c4-2df2-4a01-9d6c-6a3ae6952766 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:35.446343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e55c4-2df2-4a01-9d6c-6a3ae6952766 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:35.446611 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e55c4-2df2-4a01-9d6c-6a3ae6952766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:35.448212 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c07e55c4-2df2-4a01-9d6c-6a3ae6952766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:35.525067 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:35.560427 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e55c4-2df2-4a01-9d6c-6a3ae6952766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:35.561911 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e55c4-2df2-4a01-9d6c-6a3ae6952766 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:35.580946 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 728/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:37.835986 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efa176-7a69-4912-b237-377beb2bb045 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:37.836569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efa176-7a69-4912-b237-377beb2bb045 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:37.836569 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efa176-7a69-4912-b237-377beb2bb045 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:37.838320 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 757/1485] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:37.843644 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce54f7-64e9-4697-b64b-84e74b44f43d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:37.844076 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce54f7-64e9-4697-b64b-84e74b44f43d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:37.844183 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce54f7-64e9-4697-b64b-84e74b44f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:37.912152 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e5ce54f7-64e9-4697-b64b-84e74b44f43d None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:37.913267 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e5ce54f7-64e9-4697-b64b-84e74b44f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:38.014248 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 729/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:38.303506 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efa176-7a69-4912-b237-377beb2bb045 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:38.305145 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-68efa176-7a69-4912-b237-377beb2bb045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:38.407632 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efa176-7a69-4912-b237-377beb2bb045 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:38.479922 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:38.481400 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ab58-182f-4b67-805a-42b9d4b5ea5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:38.482040 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ab58-182f-4b67-805a-42b9d4b5ea5c service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:38.482541 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ab58-182f-4b67-805a-42b9d4b5ea5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:38.483016 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ab58-182f-4b67-805a-42b9d4b5ea5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:38.484862 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a481ab58-182f-4b67-805a-42b9d4b5ea5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:38.593351 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ab58-182f-4b67-805a-42b9d4b5ea5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:38.594761 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ab58-182f-4b67-805a-42b9d4b5ea5c service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:38.612837 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 758/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:40.973532 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf5b0f-fbd4-49a8-82e0-b071234ad95b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:40.974173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf5b0f-fbd4-49a8-82e0-b071234ad95b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:40.974173 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf5b0f-fbd4-49a8-82e0-b071234ad95b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:40.975464 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 730/1488] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:40.980901 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7902c0-9b49-40fe-bcf6-9a340f85eb55 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:40.981584 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7902c0-9b49-40fe-bcf6-9a340f85eb55 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:40.981838 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7902c0-9b49-40fe-bcf6-9a340f85eb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:41.049353 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3c7902c0-9b49-40fe-bcf6-9a340f85eb55 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:41.050612 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3c7902c0-9b49-40fe-bcf6-9a340f85eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:41.103265 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:41.147616 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 759/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:41.443526 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf5b0f-fbd4-49a8-82e0-b071234ad95b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:41.445089 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3bdf5b0f-fbd4-49a8-82e0-b071234ad95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:41.482402 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:41.552241 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf5b0f-fbd4-49a8-82e0-b071234ad95b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:41.628983 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f362e-9f0c-42a2-9f54-c01fc2286fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:41.629589 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f362e-9f0c-42a2-9f54-c01fc2286fdb service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:41.629888 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f362e-9f0c-42a2-9f54-c01fc2286fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:41.630159 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f362e-9f0c-42a2-9f54-c01fc2286fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:41.631750 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d88f362e-9f0c-42a2-9f54-c01fc2286fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:41.712992 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:41.742607 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f362e-9f0c-42a2-9f54-c01fc2286fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:41.744718 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f362e-9f0c-42a2-9f54-c01fc2286fdb service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:41.762372 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 731/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 02:41:44.178637 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292961-7535-4aab-abd9-7ef9580eac02 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:44.179211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292961-7535-4aab-abd9-7ef9580eac02 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:44.179211 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292961-7535-4aab-abd9-7ef9580eac02 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:44.180500 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 760/1491] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 22 02:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:41:44.185887 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5721e1-f53a-4720-a74e-d601f80d97c5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:44.186346 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5721e1-f53a-4720-a74e-d601f80d97c5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:44.186445 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5721e1-f53a-4720-a74e-d601f80d97c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:44.253103 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4a5721e1-f53a-4720-a74e-d601f80d97c5 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:41:44.254364 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4a5721e1-f53a-4720-a74e-d601f80d97c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:44.366927 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 732/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 22 02:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:41:44.657588 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292961-7535-4aab-abd9-7ef9580eac02 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:41:44.659216 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-31292961-7535-4aab-abd9-7ef9580eac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:44.763964 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292961-7535-4aab-abd9-7ef9580eac02 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:41:44.837030 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c43256-3729-4628-8c6c-161594687122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:41:44.837544 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43256-3729-4628-8c6c-161594687122 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:41:44.837848 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43256-3729-4628-8c6c-161594687122 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:41:44.838124 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43256-3729-4628-8c6c-161594687122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:41:44.839733 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e6c43256-3729-4628-8c6c-161594687122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:41:44.848165 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:44.948118 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c43256-3729-4628-8c6c-161594687122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:41:44.949538 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c43256-3729-4628-8c6c-161594687122 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:41:44.967788 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 761/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:41:54.365345 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=82 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:41:54.965378 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=50 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:04.857246 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:04.857862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:04.857862 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:04.937498 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:43:04.938782 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:05.035396 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 733/1494] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 22 02:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:43:05.044421 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47703d1-53f3-4857-867b-2d102879220f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:05.044987 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47703d1-53f3-4857-867b-2d102879220f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:05.044987 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47703d1-53f3-4857-867b-2d102879220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:05.122007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e47703d1-53f3-4857-867b-2d102879220f None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:43:05.123139 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e47703d1-53f3-4857-867b-2d102879220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:05.218458 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 762/1495] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 22 02:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:43:05.223304 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:05.225046 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:05.237121 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561d2a3-d1fb-4ed7-8dd7-a56d958b4098 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:05.300978 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:05.337869 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:05.338470 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:05.338743 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:05.339007 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:05.339647 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 02:43:05.339938 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:05.340945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:05.340945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 22 02:43:05.340945 dv-cinder-857075-7-smb devstack@keystone.service[88076]: Sep 22 02:43:05.341860 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:05.353817 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 734/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 22 02:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 02:43:05.362309 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47703d1-53f3-4857-867b-2d102879220f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:05.371570 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47703d1-53f3-4857-867b-2d102879220f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:05.432641 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:05.466695 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:05.467304 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:05.467580 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:05.467849 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:05.468487 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:05.470258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:05.470258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 22 02:43:05.470258 dv-cinder-857075-7-smb devstack@keystone.service[88077]: Sep 22 02:43:05.471455 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:05.528977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 763/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 22 02:43:05 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:43:05.533262 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:05.534849 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:05.578323 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c036677-9db0-422e-a063-4d62aeecec5b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:05.674198 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:05.674804 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:05.675076 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:05.675343 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:05.675961 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:05.676960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:05.676960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 22 02:43:05.676960 dv-cinder-857075-7-smb devstack@keystone.service[88076]: Sep 22 02:43:05.678191 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:05.722544 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 735/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 22 02:43:05 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 02:43:05.727523 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:05.729430 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:05.791247 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807864b-0375-4265-8765-ba7f9e28bb90 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:05.885415 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:05.901239 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:05.901890 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:05.902176 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:05.902452 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:05.903105 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:05.904125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:05.904125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 22 02:43:05.904125 dv-cinder-857075-7-smb devstack@keystone.service[88077]: Sep 22 02:43:05.905007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:05.917710 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 764/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 22 02:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:43:05.922136 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:05.923676 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:05.936030 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267504cb-4dd7-4b25-ae0f-6009f84316f2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:05.961876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:06.034135 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cab6a-5928-4d5a-966c-6c14196f077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:06.034652 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cab6a-5928-4d5a-966c-6c14196f077f admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:06.034934 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cab6a-5928-4d5a-966c-6c14196f077f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:06.035204 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cab6a-5928-4d5a-966c-6c14196f077f admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:06.035854 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cab6a-5928-4d5a-966c-6c14196f077f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:06.036873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-d21cab6a-5928-4d5a-966c-6c14196f077f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:06.036873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 22 02:43:06.036873 dv-cinder-857075-7-smb devstack@keystone.service[88076]: Sep 22 02:43:06.037790 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cab6a-5928-4d5a-966c-6c14196f077f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:06.050842 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 736/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 22 02:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 02:43:06.055522 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:06.057067 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:06.092429 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4facf1-491a-4118-aa47-a21b5a45a32e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:06.199055 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f46c82-e83e-4caf-9233-502d980890dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:06.199724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f46c82-e83e-4caf-9233-502d980890dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:06.200006 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f46c82-e83e-4caf-9233-502d980890dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:06.200282 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f46c82-e83e-4caf-9233-502d980890dd admin admin] PATH_INFO: `/v3/projects/2281be930a5e4a918793146f8a05b115/users/9a383c4c39924312ac371f04ed8666c6/roles/c5260227d3ff4cbf956c47e3590a0ba1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:06.223237 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f46c82-e83e-4caf-9233-502d980890dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2281be930a5e4a918793146f8a05b115, user_id=9a383c4c39924312ac371f04ed8666c6, role_id=c5260227d3ff4cbf956c47e3590a0ba1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:06.224261 dv-cinder-857075-7-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-a2f46c82-e83e-4caf-9233-502d980890dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:06.224261 dv-cinder-857075-7-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 22 02:43:06.224261 dv-cinder-857075-7-smb devstack@keystone.service[88077]: Sep 22 02:43:06.226291 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f46c82-e83e-4caf-9233-502d980890dd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:06.252932 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 765/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 22 02:43:06 2022] PUT /identity/v3/projects/2281be930a5e4a918793146f8a05b115/users/9a383c4c39924312ac371f04ed8666c6/roles/c5260227d3ff4cbf956c47e3590a0ba1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:43:06.266311 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4458-0e7c-4c69-8818-f7f1d298b456 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:06.266597 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4458-0e7c-4c69-8818-f7f1d298b456 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:06.266876 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4458-0e7c-4c69-8818-f7f1d298b456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:06.327025 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2c7b4458-0e7c-4c69-8818-f7f1d298b456 None None] MFA Rules not processed for user `9a383c4c39924312ac371f04ed8666c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:43:06.328140 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2c7b4458-0e7c-4c69-8818-f7f1d298b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:06.407388 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 737/1502] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 22 02:43:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:43:06.421413 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966339b-d2fb-493f-af68-75c6ce164965 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:06.421724 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966339b-d2fb-493f-af68-75c6ce164965 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:06.422009 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966339b-d2fb-493f-af68-75c6ce164965 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:06.423340 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 766/1503] 10.222.0.57 () {54 vars in 963 bytes} [Thu Sep 22 02:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:43:06.428736 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a200-0336-4677-9d27-7ed4fd5246db None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:06.429014 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a200-0336-4677-9d27-7ed4fd5246db None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:06.429281 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a200-0336-4677-9d27-7ed4fd5246db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:06.461438 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:06.514504 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c262a200-0336-4677-9d27-7ed4fd5246db None None] MFA Rules not processed for user `a5cf3b19d04044fda6a4aa1b5d7aff2c`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:43:06.515729 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c262a200-0336-4677-9d27-7ed4fd5246db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:06.598358 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 738/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Thu Sep 22 02:43:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:43:06.606818 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966339b-d2fb-493f-af68-75c6ce164965 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:06.608394 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1966339b-d2fb-493f-af68-75c6ce164965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:06.659941 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:06.716893 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966339b-d2fb-493f-af68-75c6ce164965 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:06.793669 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf3b19d04044fda6a4aa1b5d7aff2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:06.794653 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:06.794851 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:06.795111 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:06.796772 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:06.908833 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:06.910208 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:06.914423 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:06.934609 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 767/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:43:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 02:43:06.982106 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffe0f8-b69b-420a-bf60-343021e44cea None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:06.982576 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffe0f8-b69b-420a-bf60-343021e44cea None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:06.982678 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffe0f8-b69b-420a-bf60-343021e44cea None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:06.983923 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 739/1506] 10.222.0.57 () {52 vars in 830 bytes} [Thu Sep 22 02:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 02:43:06.987651 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:06.988873 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:07.092088 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132498-2584-47d3-aa17-3f22ca11a841 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:07.187761 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:07.188389 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:07.188659 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:07.188926 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] PATH_INFO: `/v3/users/9a383c4c39924312ac371f04ed8666c6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:07.202679 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a383c4c39924312ac371f04ed8666c6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:07.203699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:07.203699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 22 02:43:07.203699 dv-cinder-857075-7-smb devstack@keystone.service[88077]: Sep 22 02:43:07.204909 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:07.215321 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:07.276566 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a383c4c39924312ac371f04ed8666c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:07.277007 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a383c4c39924312ac371f04ed8666c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:07.277535 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a383c4c39924312ac371f04ed8666c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:07.304087 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a383c4c39924312ac371f04ed8666c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:07.318977 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a383c4c39924312ac371f04ed8666c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:07.333621 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 768/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 22 02:43:06 2022] DELETE /identity/v3/users/9a383c4c39924312ac371f04ed8666c6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 02:43:07.340169 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:07.340449 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:07.340719 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:07.402060 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] MFA Rules not processed for user `2693edda8d0d489e8bc6601783092eda`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 02:43:07.403324 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:07.482741 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:07.496210 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 740/1508] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 22 02:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 02:43:07.506790 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:07.508137 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:07.618177 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877669f0-ce5f-45c8-8963-231d8ecabbff admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:07.675558 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:07.697791 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bedd7-9bd8-4d22-8699-5489d324e7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb868fc365140a39e3f64166df3e1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb7f72fad4e743f8b3294a3e754210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:07.698409 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bedd7-9bd8-4d22-8699-5489d324e7eb service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:07.698684 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bedd7-9bd8-4d22-8699-5489d324e7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:07.698978 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bedd7-9bd8-4d22-8699-5489d324e7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:07.700591 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4a2bedd7-9bd8-4d22-8699-5489d324e7eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:07.810533 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bedd7-9bd8-4d22-8699-5489d324e7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:07.811877 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bedd7-9bd8-4d22-8699-5489d324e7eb service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:07.833935 dv-cinder-857075-7-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 769/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 22 02:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 02:43:08.190678 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 02:43:08.192520 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 02:43:08.205059 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30255-eeca-4bac-92b9-8d9645549ad4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 02:43:08.314435 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2693edda8d0d489e8bc6601783092eda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37cfa01ad9247dab92fb4fc2b4b39f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 02:43:08.315104 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 02:43:08.315382 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 02:43:08.315650 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] PATH_INFO: `/v3/projects/2281be930a5e4a918793146f8a05b115` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 02:43:08.326848 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2281be930a5e4a918793146f8a05b115)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 02:43:08.327879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 02:43:08.327879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 22 02:43:08.327879 dv-cinder-857075-7-smb devstack@keystone.service[88076]: Sep 22 02:43:08.329079 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 02:43:08.390363 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2281be930a5e4a918793146f8a05b115', 'request_id': 'req-b431ffb0-6068-4852-ac68-fe58f28c4efd'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:08.396964 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2281be930a5e4a918793146f8a05b115', 'request_id': 'req-b431ffb0-6068-4852-ac68-fe58f28c4efd'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:08.406546 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2281be930a5e4a918793146f8a05b115', 'request_id': 'req-b431ffb0-6068-4852-ac68-fe58f28c4efd'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:08.441341 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] The token cache is being invalidate because project 2281be930a5e4a918793146f8a05b115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 02:43:08.441626 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:08.442185 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b431ffb0-6068-4852-ac68-fe58f28c4efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 02:43:08.443505 dv-cinder-857075-7-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 741/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 22 02:43:08 2022] DELETE /identity/v3/projects/2281be930a5e4a918793146f8a05b115 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 02:43:17.831210 dv-cinder-857075-7-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=62 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 02:43:18.439077 dv-cinder-857075-7-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}